00000001:02000400:0.0F:1788725630.602799:0:3294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788725649.966515:0:3515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788725652.006845:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 403 MB/s 00000001:01000000:2.0:1788725652.256151:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 503 MB/s 00000001:01000000:0.0:1788725652.509309:0:3577:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3699 MB/s 00000020:02000000:3.0F:1788725653.383555:0:3607:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g794a134 00000400:02000000:3.0:1788725654.585902:0:3622:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.112@tcp [8/256/0/180] 00008000:02000000:3.0:1788725657.948114:0:3771:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788725716.598648:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788725729.013189:0:6488:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788725729.013196:0:6488:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788725729.013198:0:6488:0:(obd_mount.c:940:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788725729.013300:0:6488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004c110f16 00000080:02000400:2.0:1788725729.013310:0:6488:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788725729.034089:0:6488:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788725729.034103:0:6488:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788725729.034392:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000a54599e) 00000020:00000080:2.0:1788725729.034411:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788725729.089704:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788725729.090262:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788725729.109526:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788725729.110280:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788725729.110290:0:6488:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788725729.110300:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d3692a 00000020:01000004:0.0:1788725729.110307:0:6488:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788725729.110311:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788725729.110315:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004c110f16 from MGS 00000020:01000004:0.0:1788725729.110319:0:6488:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788725729.110339:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000008e592c1) 00000020:00000080:0.0:1788725729.110350:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788725729.110853:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c110f16 from MGS, refs=2 00080000:01000000:0.0:1788725729.110862:0:6488:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788725729.110992:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d36938 00000100:00100000:0.0:1788725729.111108:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788725729.111376:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788725729.111382:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788725729.111961:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788725729.111969:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788725729.112673:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725729.112835:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788725729.112840:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788725729.113642:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788725729.113653:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788725729.114078:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788725729.114086:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788725729.114835:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.114840:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.114842:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.122048:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.122055:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.122057:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725729.127388:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788725729.130459:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788725729.378484:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2406 MB/s 00000001:01000000:3.0:1788725729.628181:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2255 MB/s 00000001:01000000:2.0:1788725729.878398:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 527 MB/s 00000001:01000000:3.0:1788725730.132966:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 622 MB/s 00080000:10000000:0.0:1788725730.149466:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1788725730.171258:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788725730.192246:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788725730.207046:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788725730.207143:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788725730.207219:0:6488:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788725730.207466:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788725730.207491:0:6488:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788725730.207984:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725730.208176:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788725730.208183:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788725730.212145:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788725730.212160:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788725730.219073:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788725730.219094:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788725730.220796:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788725730.220826:0:6488:0:(obd_mount.c:422:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:0.0:1788725730.220828:0:6488:0:(obd_mount.c:431:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788725730.220880:0:6488:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:0.0:1788725730.220898:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (00000000d7a8236e) 00000020:00000080:0.0:1788725730.220912:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788725730.221008:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ea519669@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788725730.221229:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:0.0:1788725730.221236:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788725730.221496:0:6507:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788725730.226850:0:6509:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788725730.226912:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 07aa06c1-b26f-4687-bdcf-2948685dbe8f) 00000020:00000080:0.0:1788725730.226933:0:6488:0:(genops.c:1385:class_connect()) connect: client 07aa06c1-b26f-4687-bdcf-2948685dbe8f, cookie 0xa13c582691d36946 00000100:00080000:0.0:1788725730.226945:0:6488:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788725730.226951:0:6488:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import 00000000ea519669 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725730.226993:0:6488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8e98c44 x1875614791368832/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788725730.227021:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS 00000020:01000004:0.0:1788725730.227039:0:6488:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788725730.227044:0:6488:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788725730.227056:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f2ee9f05) 00000020:00000080:0.0:1788725730.227066:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788725730.229474:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8e98c44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791368832:0@lo:250: 00000100:00100000:3.0:1788725730.229568:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.230432:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791368832 00000100:00100000:3.0:1788725730.230443:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791368832 00000100:00100000:3.0:1788725730.230484:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725730.230491:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a76055c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1875614791368832:12345-0@lo:250: 00010000:00080000:3.0:1788725730.230517:0:6504:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 07aa06c1-b26f-4687-bdcf-2948685dbe8f@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1788725730.230541:0:6504:0:(genops.c:1385:class_connect()) connect: client 07aa06c1-b26f-4687-bdcf-2948685dbe8f, cookie 0xa13c582691d36954 00000100:00080000:3.0:1788725730.230680:0:6504:0:(import.c:65:import_set_state_nolock()) 00000000033c11f8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725730.230733:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a76055c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:3637:x1875614791368832:12345-0@lo:250: Request processed in 241us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.230741:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725730.230776:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788725730.230785:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1788725730.230791:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788725730.230795:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788725730.230797:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ea519669 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788725730.230800:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788725730.230803:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788725730.230807:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8e98c44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791368832:0@lo:250: 00000100:00100000:3.0:1788725730.248630:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725730.248830:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788725730.248844:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788725730.254913:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788725730.254928:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788725730.255566:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788725730.255574:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788725730.256725:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788725730.256984:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788725730.256990:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788725730.258603:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788725730.258617:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788725730.352502:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725730.352708:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788725730.352714:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788725730.354560:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788725730.354573:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788725730.355534:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725730.355732:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788725730.355748:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788725730.360655:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788725730.360667:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788725730.361499:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725730.361681:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788725730.361687:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788725730.365398:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788725730.365414:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788725730.366180:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725730.366351:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788725730.366356:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788725730.368870:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788725730.368883:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788725730.415324:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725730.415557:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788725730.415563:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788725730.423892:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788725730.423908:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788725730.424865:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788725730.424946:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788725730.426011:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788725730.426040:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788725730.426045:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788725730.426296:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788725730.426333:0:6488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788725730.426338:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788725730.426339:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788725730.426341:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725730.426342:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725730.426344:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725730.426345:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725730.426346:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725730.426348:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788725730.426349:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725730.426350:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725730.426351:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725730.426353:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725730.426355:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788725730.426357:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788725730.426362:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788725730.426363:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725730.426364:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725730.426365:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725730.426366:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725730.426366:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725730.426367:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788725730.426368:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725730.426369:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725730.426370:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725730.426370:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725730.426399:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788725730.426418:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000eb96d16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791368960:0@lo:253: 00000100:00100000:1.0:1788725730.426489:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725730.426566:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eed95e3c going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.426605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791368960 00000100:00100000:2.0:1788725730.426612:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791368960 00000100:00100000:2.0:1788725730.426674:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725730.426682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006552a8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6488:x1875614791368960:12345-0@lo:253: 20000000:01000000:2.0:1788725730.426723:0:6506:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788725730.426726:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788725730.427058:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788725730.427108:0:6506:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788725730.427410:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725730.428319:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788725730.428537:0:6506:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788725730.428541:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788725730.428547:0:6506:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788725730.428549:0:6506:0:(mgs_llog.c:3615:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788725730.428559:0:6506:0:(mgs_llog.c:3175:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788725730.428676:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725730.428947:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788725730.428960:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788725730.428980:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788725730.428997:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788725730.429012:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788725730.429061:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788725730.429069:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788725730.429097:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788725730.429104:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788725730.429190:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788725730.429197:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788725730.429212:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788725730.429227:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788725730.429253:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788725730.429258:0:6506:0:(mgs_llog.c:3175:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788725730.429264:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725730.429344:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788725730.429359:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788725730.429374:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788725730.429387:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788725730.429402:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788725730.429410:0:6506:0:(mgs_llog.c:3132:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788725730.429432:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788725730.429440:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788725730.429452:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788725730.429465:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788725730.429478:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788725730.429485:0:6506:0:(mgs_llog.c:3097:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788725730.429504:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788725730.429511:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788725730.429524:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788725730.429539:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788725730.429588:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788725730.429607:0:6506:0:(mgs_llog.c:3312:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788725730.429618:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788725730.430097:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788725730.430494:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788725730.430511:0:6506:0:(mgs_llog.c:3358:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:2.0:1788725730.430512:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788725730.430542:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788725730.430549:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788725730.430560:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788725730.430564:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:2.0:1788725730.430574:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788725730.430579:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788725730.430591:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788725730.430604:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788725730.430629:0:6506:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788725730.430632:0:6506:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788725730.430640:0:6506:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788725730.430692:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788725730.430694:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788725730.431016:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788725730.431314:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788725730.431331:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788725730.431344:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788725730.431352:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788725730.431354:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788725730.431583:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788725730.431719:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788725730.431736:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788725730.431831:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788725730.431841:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788725730.431843:0:6506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788725730.431847:0:6506:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788725730.431849:0:6506:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788725730.431854:0:6506:0:(mgs_llog.c:5075:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788725730.431859:0:6506:0:(mgs_llog.c:1382:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788725730.432350:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788725730.432471:0:6506:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788725730.443709:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788725730.443860:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788725730.443879:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788725730.443909:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788725730.443936:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.443956:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444034:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444063:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444070:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444076:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444082:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000024509bdd already unused, calling callback (00000000f88379cb) 00010000:00010000:2.0:1788725730.444087:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444094:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444110:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444208:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.444216:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000024509bdd/0xa13c582691d3695b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788725730.444278:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788725730.454455:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006552a8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6488:x1875614791368960:12345-0@lo:253: Request processed in 27762us (27955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725730.454481:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725730.454697:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000eb96d16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791368960:0@lo:253: 10000000:01000000:2.0:1788725730.454717:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788725730.455002:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725730.455005:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788725730.455022:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725730.455023:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788725730.455025:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725730.455026:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725730.455028:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788725730.455029:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788725730.455031:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788725730.455032:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725730.455034:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788725730.455056:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004c110f16 from lustre-MDT0000 10000000:01000000:2.0:1788725730.455097:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788725730.455101:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788725730.455106:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b13a96d0000 10000000:01000000:2.0:1788725730.455111:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788725730.456925:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b13a96d0000 from 1 10000000:01000000:1.0:1788725730.456935:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788725730.456990:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.457003:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.457014:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725730.457038:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b606d315 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369088:0@lo:101: 00000100:00100000:1.0:1788725730.457171:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725730.457280:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b1bbee15 going to sleep for 11 seconds 00000100:00100000:3.0:1788725730.457611:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369088 00000100:00100000:3.0:1788725730.457621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369088 00000100:00100000:3.0:1788725730.457673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725730.457681:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004856fea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6488:x1875614791369088:12345-0@lo:101: 00010000:00010000:3.0:1788725730.457696:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725730.457713:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36962 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.457750:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36962 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.457760:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36962 expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.457771:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e57d39eb, rc 0) 00000100:00100000:3.0:1788725730.457823:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004856fea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:6488:x1875614791369088:12345-0@lo:101: Request processed in 142us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.457841:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725730.457988:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b606d315 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369088:0@lo:101: 00010000:00010000:2.0:1788725730.458004:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.458013:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.458094:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369216:0@lo:501: 00000100:00100000:2.0:1788725730.458159:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.458175:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8cbbc7d going to sleep for 11 seconds 00000100:00100000:1.0:1788725730.458243:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369216 00000100:00100000:1.0:1788725730.458249:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369216 00000100:00100000:1.0:1788725730.458285:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725730.458292:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1883195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:6488:x1875614791369216:12345-0@lo:501: 00000100:00100000:1.0:1788725730.458393:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1883195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:6488:x1875614791369216:12345-0@lo:501: Request processed in 101us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725730.458400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725730.458558:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369216:0@lo:501: 10000000:01000000:2.0:1788725730.458589:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788725730.458599:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.458607:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725730.458629:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b139116a000 10000000:01000000:2.0:1788725730.458633:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788725730.458638:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b139116a000 10000000:01000000:2.0:1788725730.458641:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788725730.458643:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b139116a000 from 1 10000000:01000000:2.0:1788725730.458645:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788725730.458662:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.458668:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.458675:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.458686:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369344:0@lo:101: 00000100:00100000:2.0:1788725730.458711:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.458738:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8cbbc7d going to sleep for 11 seconds 00000100:00100000:1.0:1788725730.458858:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369344 00000100:00100000:1.0:1788725730.458862:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369344 00000100:00100000:1.0:1788725730.458879:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788725730.458894:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a21e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:6488:x1875614791369344:12345-0@lo:101: 00010000:00010000:1.0:1788725730.458902:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725730.458914:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f161a539/0xa13c582691d36977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36970 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.458926:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f161a539/0xa13c582691d36977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36970 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.458934:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f161a539/0xa13c582691d36977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36970 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.458941:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f161a539, rc 0) 00000100:00100000:1.0:1788725730.458974:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a21e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+7:6488:x1875614791369344:12345-0@lo:101: Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725730.458980:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725730.459390:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369344:0@lo:101: 00010000:00010000:2.0:1788725730.459400:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.459407:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725730.459476:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788725730.459488:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.459507:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000024509bdd/0xa13c582691d36970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725730.459513:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788725730.459516:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725730.459521:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b139116a000 10000000:01000000:2.0:1788725730.459523:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788725730.459526:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788725730.459578:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725730.459594:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.459600:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.459607:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.459619:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369472:0@lo:101: 00000100:00100000:2.0:1788725730.459653:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.459711:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8cbbc7d going to sleep for 11 seconds 00000100:00100000:1.0:1788725730.459956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369472 00000100:00100000:1.0:1788725730.459961:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369472 00000100:00100000:1.0:1788725730.460031:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788725730.460040:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001294553c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+7:6488:x1875614791369472:12345-0@lo:101: 00010000:00010000:1.0:1788725730.460056:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725730.460065:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3697e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.460081:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3697e expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.460090:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3697e expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.460097:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be5cb84f, rc 0) 00000100:00100000:1.0:1788725730.460163:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001294553c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+8:6488:x1875614791369472:12345-0@lo:101: Request processed in 124us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725730.460170:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788725730.460231:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b04cf63c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369472:0@lo:101: 00010000:00010000:3.0:1788725730.460242:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.460248:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725730.460332:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab9200aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369600:0@lo:501: 00000100:00100000:3.0:1788725730.460372:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.460739:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e91f8960 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.461287:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369600 00000100:00100000:2.0:1788725730.461294:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369600 00000100:00100000:2.0:1788725730.461322:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725730.461328:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e03c52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+8:6488:x1875614791369600:12345-0@lo:501: 00000100:00100000:2.0:1788725730.462740:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e03c52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6488:x1875614791369600:12345-0@lo:501: Request processed in 1394us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725730.462755:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788725730.464043:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab9200aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369600:0@lo:501: 00000100:00100000:3.0:1788725730.464648:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab9200aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369728:0@lo:503: 00000100:00100000:3.0:1788725730.465035:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.465206:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e91f8960 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.465680:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369728 00000100:00100000:2.0:1788725730.465690:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369728 00000100:00100000:3.0:1788725730.467424:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788725730.467439:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc7d3a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6488:x1875614791369728:12345-0@lo:503: 00000100:00100000:3.0:1788725730.468161:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc7d3a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6488:x1875614791369728:12345-0@lo:503: Request processed in 722us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.468171:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725730.468276:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab9200aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791369728:0@lo:503: 00000100:00100000:3.0:1788725730.469251:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e29c36b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6532:1875614791369856:0@lo:502: 00000100:00100000:3.0:1788725730.469317:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.469387:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a90f548f going to sleep for 11 seconds 00000100:00100000:0.0:1788725730.469573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369856 00000100:00100000:0.0:1788725730.469582:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369856 00000100:00100000:0.0:1788725730.469636:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725730.469646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41f8b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6532:x1875614791369856:12345-0@lo:502: 00000100:00100000:0.0:1788725730.469819:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41f8b61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6532:x1875614791369856:12345-0@lo:502: Request processed in 175us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.469827:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725730.469975:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e29c36b5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6532:1875614791369856:0@lo:502: 00000020:01000000:2.0:1788725730.470002:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725730.470016:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.470019:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788725730.470025:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788725730.470029:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725730.470047:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000fa6015e4) 00000020:00000080:2.0:1788725730.470070:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788725730.470077:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788725730.470207:0:6532:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788725730.470215:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d36993 00000020:00000080:2.0:1788725730.470496:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788725730.470501:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725730.470505:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.470506:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788725730.470509:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725730.470513:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.470514:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788725730.470517:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725730.470525:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000024d2bb73) 00000020:00000080:2.0:1788725730.470535:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788725730.470539:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788725730.470540:0:6532:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788725730.470543:0:6532:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788725730.470549:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788725730.470592:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c110f16 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788725730.470605:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004ec535ba) 00000020:00000080:2.0:1788725730.470612:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788725730.470699:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788725730.470710:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d369a8 00000020:00000080:2.0:1788725730.470940:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788725730.470946:0:6532:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788725730.470951:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa13c582691d369af 00080000:01000000:2.0:1788725730.470955:0:6532:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788725730.470959:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d369b6 00080000:10000000:2.0:1788725730.471858:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788725730.472028:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788725730.478162:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788725730.589833:0:6532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788725730.596239:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788725730.610016:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788725730.610771:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788725730.622112:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e1034205) 00000020:00000080:1.0:1788725730.622162:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788725730.622306:0:6532:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788725730.622315:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d369c4 00000020:00000080:1.0:1788725730.623800:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788725730.625425:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788725730.642791:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788725730.649086:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788725730.652558:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788725730.656172:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788725730.659364:0:6532:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788725730.663854:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa13c582691d369cb 00000020:00000080:2.0:1788725730.664518:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788725730.664532:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725730.664539:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.664542:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788725730.664545:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725730.664550:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.664552:0:6532:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788725730.664555:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788725730.664556:0:6532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788725730.664559:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725730.664562:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.664563:0:6532:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788725730.664565:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725730.664570:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725730.664572:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788725730.664577:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788725730.664620:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788725730.664691:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000518c89a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6532:1875614791369984:0@lo:502: 00000100:00100000:2.0:1788725730.664864:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.664975:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2e21fa8 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.665608:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791369984 00000100:00100000:2.0:1788725730.665620:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791369984 00000100:00100000:2.0:1788725730.665710:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725730.665720:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d31a6ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6532:x1875614791369984:12345-0@lo:502: 00000100:00100000:2.0:1788725730.665936:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d31a6ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6532:x1875614791369984:12345-0@lo:502: Request processed in 217us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725730.665944:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788725730.666311:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000518c89a7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6532:1875614791369984:0@lo:502: 00000020:01000000:0.0:1788725730.666351:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725730.666359:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725730.666361:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788725730.666367:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788725730.667404:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788725730.667446:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788725730.667490:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.667505:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725730.667514:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139116a000 from 1 10000000:01000000:3.0:1788725730.667517:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725730.667569:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.667577:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.667587:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725730.667611:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370112:0@lo:101: 00000100:00100000:3.0:1788725730.667695:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725730.667926:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370112 00000100:00100000:1.0:1788725730.667935:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370112 00000100:00100000:1.0:1788725730.668000:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788725730.668010:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e75efafd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:6488:x1875614791370112:12345-0@lo:101: 00010000:00010000:1.0:1788725730.668026:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725730.668039:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d369d2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.668073:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d369d2 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.668094:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369d2 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.668104:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000edb716c2, rc 0) 00000100:00100000:1.0:1788725730.668173:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e75efafd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:6488:x1875614791370112:12345-0@lo:101: Request processed in 165us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.668178:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089833b3a going to sleep for 11 seconds 00000100:00100000:1.0:1788725730.668180:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725730.668268:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370112:0@lo:101: 00010000:00010000:3.0:1788725730.668281:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.668289:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.669521:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072171c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370240:0@lo:256: 00000100:00100000:2.0:1788725730.672687:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.673303:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000def97504 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.673363:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370240 00000100:00100000:2.0:1788725730.673374:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370240 00000100:00100000:3.0:1788725730.673563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725730.673577:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a82b2373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:6488:x1875614791370240:12345-0@lo:256: 20000000:01000000:3.0:1788725730.673628:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788725730.673636:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788725730.673879:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a82b2373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:6488:x1875614791370240:12345-0@lo:256: Request processed in 306us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.673963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725730.674200:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072171c03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370240:0@lo:256: 10000000:01000000:0.0:1788725730.675382:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725730.675411:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.675484:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725730.676349:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139116a000 from 1 10000000:01000000:3.0:1788725730.676356:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725730.676483:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.676495:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.676508:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725730.676538:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370368:0@lo:101: 00000100:00100000:3.0:1788725730.676617:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.676665:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e91f8960 going to sleep for 11 seconds 00000100:00100000:0.0:1788725730.676847:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370368 00000100:00100000:0.0:1788725730.676856:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370368 00000100:00100000:0.0:1788725730.676923:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725730.676934:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d934ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:6488:x1875614791370368:12345-0@lo:101: 00010000:00010000:0.0:1788725730.676950:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725730.676968:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d369e0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.676994:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d369e0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.677023:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369e0 expref: 11 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.677032:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b11ff559, rc 0) 00000100:00100000:0.0:1788725730.677252:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d934ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370368:12345-0@lo:101: Request processed in 320us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.677259:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788725730.677568:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370368:0@lo:101: 00010000:00010000:1.0:1788725730.677585:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.677594:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.677831:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018d16196 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370496:0@lo:501: 00000100:00100000:2.0:1788725730.677868:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.677938:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012f80847 going to sleep for 11 seconds 00000100:00100000:0.0:1788725730.677974:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370496 00000100:00100000:0.0:1788725730.677979:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370496 00000100:00100000:0.0:1788725730.678047:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725730.678055:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064a2fb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370496:12345-0@lo:501: 00000100:00100000:0.0:1788725730.678316:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064a2fb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370496:12345-0@lo:501: Request processed in 262us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.678324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725730.678398:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018d16196 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370496:0@lo:501: 00000100:00100000:3.0:1788725730.678446:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370624:0@lo:503: 00000100:00100000:3.0:1788725730.678489:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.679167:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b90c4d05 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.679268:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370624 00000100:00100000:2.0:1788725730.679274:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370624 00000100:00100000:2.0:1788725730.679308:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788725730.679318:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005db66c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370624:12345-0@lo:503: 00000040:00080000:2.0:1788725730.679366:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788725730.679513:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370624:0@lo:503: 00000040:00080000:3.0:1788725730.680277:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788725730.680342:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788725730.680362:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788725730.680376:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.680399:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725730.680591:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788725730.680595:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b139116a000 10000000:01000000:3.0:1788725730.680598:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b139116a000 10000000:01000000:3.0:1788725730.680603:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725730.680609:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139116a000 from 1 10000000:01000000:3.0:1788725730.680612:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725730.680648:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.680657:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.680667:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725730.680687:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370752:0@lo:101: 00000100:00100000:2.0:1788725730.680811:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005db66c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370624:12345-0@lo:503: Request processed in 1492us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725730.680821:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725730.681045:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.681086:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e91f8960 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.681332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370752 00000100:00100000:2.0:1788725730.681339:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370752 00000100:00100000:2.0:1788725730.681370:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788725730.681379:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b13b9bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6488:x1875614791370752:12345-0@lo:101: 00010000:00010000:2.0:1788725730.681407:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725730.681528:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d369ee expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.681675:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.681688:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.681698:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee63c0f7, rc 0) 00000100:00100000:3.0:1788725730.681752:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b13b9bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791370752:12345-0@lo:101: Request processed in 374us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.681765:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725730.681816:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370752:0@lo:101: 00010000:00010000:3.0:1788725730.681832:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.681840:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725730.681915:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370880:0@lo:501: 00000100:00100000:3.0:1788725730.681944:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.681960:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e91f8960 going to sleep for 11 seconds 00000100:00100000:3.0:1788725730.681984:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791370880 00000100:00100000:3.0:1788725730.681987:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791370880 00000100:00100000:3.0:1788725730.682006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725730.682012:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c6c748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791370880:12345-0@lo:501: 00000100:00100000:3.0:1788725730.682483:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c6c748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791370880:12345-0@lo:501: Request processed in 469us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725730.682491:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788725730.682570:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791370880:0@lo:501: 00000100:00100000:2.0:1788725730.682602:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791371008:0@lo:503: 00000100:00100000:2.0:1788725730.682647:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.682675:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a73e296 going to sleep for 11 seconds 00000100:00100000:0.0:1788725730.682764:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371008 00000100:00100000:0.0:1788725730.682769:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371008 00000100:00100000:0.0:1788725730.682796:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788725730.682802:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b6dd783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791371008:12345-0@lo:503: 00000100:00100000:0.0:1788725730.682899:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b6dd783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791371008:12345-0@lo:503: Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.682906:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788725730.683084:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791371008:0@lo:503: 00000100:00100000:3.0:1788725730.686942:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6537:1875614791371136:0@lo:502: 00000100:00100000:3.0:1788725730.687073:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725730.687311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371136 00000100:00100000:0.0:1788725730.687321:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371136 00000100:00100000:0.0:1788725730.687377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788725730.687387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052841a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6537:x1875614791371136:12345-0@lo:502: 00000100:00100000:0.0:1788725730.687637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052841a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6537:x1875614791371136:12345-0@lo:502: Request processed in 251us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.687653:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725730.687817:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 000000002388387a going to sleep for 11 seconds 00000100:00100000:3.0:1788725730.687845:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6537:1875614791371136:0@lo:502: 00000020:01000004:3.0:1788725730.687930:0:6537:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788725730.687960:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000888bf7c6) 00000020:00000080:3.0:1788725730.687986:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788725730.688272:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c110f16 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788725730.688282:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004c110f16 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788725730.688284:0:6537:0:(obd_mount.c:721:lustre_put_lsi()) put 000000004c110f16 4 00010000:00080000:3.0:1788725730.688320:0:6537:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ff7ef31f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788725730.696295:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788725730.696676:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788725730.696802:0:6537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788725730.696819:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa13c582691d36a03 00000100:00080000:3.0:1788725730.696833:0:6537:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725730.696838:0:6537:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ff7ef31f using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725730.696906:0:6537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e80b716 x1875614791371264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725730.696972:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791371264:0@lo:38: 00000100:00100000:1.0:1788725730.697086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725730.697383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371264 00000100:00100000:3.0:1788725730.697392:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371264 00000100:00100000:3.0:1788725730.697440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725730.697449:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c58da3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791371264:12345-0@lo:38: 00000100:00080000:2.0:1788725730.699909:0:6537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788725730.701378:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6537:1875614791371392:0@lo:502: 00000100:00100000:2.0:1788725730.701510:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.701573:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a48bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725730.708699:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371392 00000100:00100000:0.0:1788725730.709924:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371392 00000100:00100000:0.0:1788725730.710063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788725730.710076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000612cfbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6537:x1875614791371392:12345-0@lo:502: 00000100:00100000:0.0:1788725730.710316:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000612cfbe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6537:x1875614791371392:12345-0@lo:502: Request processed in 242us (8806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.710324:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788725730.712983:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6537:1875614791371392:0@lo:502: 00000040:00080000:2.0:1788725730.713066:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788725730.713180:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788725730.713210:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725730.713230:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.713243:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788725730.713308:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788725730.713311:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788725730.713312:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725730.713313:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725730.713319:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725730.713320:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725730.713322:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788725730.713323:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788725730.713324:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725730.713325:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725730.713327:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725730.713328:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788725730.713332:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788725730.713335:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788725730.713337:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788725730.713337:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725730.713338:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725730.713339:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725730.713340:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725730.713341:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788725730.713342:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788725730.713343:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725730.713344:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725730.713345:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725730.713346:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788725730.713378:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788725730.713398:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791371520:0@lo:253: 00000100:00100000:3.0:1788725730.714126:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c58da3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791371264:12345-0@lo:38: Request processed in 16662us (17026us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788725730.714140:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725730.715528:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788725730.715540:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ff7ef31f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788725730.715547:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788725730.715550:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791371264:0@lo:38: 00000100:00100000:2.0:1788725730.716215:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.716277:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a48bb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725730.716532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371520 00000100:00100000:1.0:1788725730.716541:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371520 00000100:00100000:1.0:1788725730.716600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725730.716619:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012716b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791371520:12345-0@lo:253: 20000000:01000000:1.0:1788725730.716655:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788725730.716671:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788725730.723386:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788725730.723424:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788725730.723813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012716b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6488:x1875614791371520:12345-0@lo:253: Request processed in 7190us (7593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725730.723831:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1788725730.723925:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788725730.723932:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788725730.723955:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.723973:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369d2 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.723980:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.724024:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.724180:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 11 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725730.724196:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008871ea6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791371648:0@lo:104: 00000100:00100000:2.0:1788725730.724242:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725730.724297:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000548cf882 going to sleep for 11 seconds 00000100:00100000:2.0:1788725730.724328:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371648 00000100:00100000:2.0:1788725730.724338:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371648 00000100:00100000:2.0:1788725730.724384:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725730.724393:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb640333 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791371648:12345-0@lo:104: 00010000:00010000:2.0:1788725730.724407:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725730.728814:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725730.728832:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb640333 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791371648:12345-0@lo:104: Request processed in 4435us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725730.728846:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725730.728966:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6488:1875614791371520:0@lo:253: 10000000:01000000:2.0:1788725730.728987:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788725730.728990:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725730.728992:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788725730.728993:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725730.728994:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725730.728995:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725730.728997:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725730.728998:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788725730.729000:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788725730.729001:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725730.729003:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725730.729005:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725730.729017:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788725730.729046:0:6488:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788725730.735676:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008871ea6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791371648:0@lo:104: 00010000:00010000:0.0:1788725730.735863:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.736968:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725730.736979:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.736992:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cbcea3e already unused, calling callback (00000000f98095d5) 10000000:00010000:3.0:1788725730.736996:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.737007:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725730.737053:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725730.737059:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725730.737152:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.737160:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725730.737183:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.737189:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000006cbcea3e/0xa13c582691d369d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369d9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725730.737210:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725730.737212:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725730.737213:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725730.737329:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725730.737348:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791371776:0@lo:103: 00000100:00100000:3.0:1788725730.737431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725730.737664:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371776 00000100:00100000:0.0:1788725730.737674:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371776 00010000:00010000:0.0:1788725730.737703:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 12 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725730.737760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725730.737771:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e29a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3638:x1875614791371776:12345-0@lo:103: 00010000:00010000:0.0:1788725730.737786:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725730.737792:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 12 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737805:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 12 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737820:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edb716c2/0xa13c582691d369d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d369d2 expref: 12 pid: 6504 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737850:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737857:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725730.737874:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013943086s 00010000:00010000:0.0:1788725730.737878:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737897:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737904:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737910:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737915:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c1db222 already unused, calling callback (00000000f88379cb) 00010000:00010000:0.0:1788725730.737919:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737926:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737934:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725730.737944:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725730.737995:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e29a3f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:3638:x1875614791371776:12345-0@lo:103: Request processed in 226us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725730.738003:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725730.739512:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791371776:0@lo:103: 00080000:10000000:2.0:1788725730.750965:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788725730.755805:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:1.0:1788725730.756483:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.756499:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725730.756506:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c1db222/0xa13c582691d36a0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788725730.757525:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788725730.757921:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788725730.758585:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788725730.759311:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788725730.760604:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788725730.760837:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788725730.761392:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788725730.761625:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788725730.761924:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788725730.762906:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788725730.778209:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788725730.798006:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788725730.798195:0:6542:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788725730.798202:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788725730.798912:0:6543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788725730.802276:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788725730.802409:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788725730.802903:0:6488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788725730.802923:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788725730.803027:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725730.806454:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788725730.807477:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:1.0:1788725730.808448:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788725730.812010:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788725730.812431:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788725730.812675:0:6488:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788725730.813598:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788725730.814963:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788725730.815408:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788725730.818218:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788725730.818363:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788725730.818866:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788725730.819028:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:1.0:1788725730.819399:0:6543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788725730.819577:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788725730.819582:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788725730.819818:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788725730.819973:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788725730.820158:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788725730.820335:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788725730.820696:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788725730.820909:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788725730.821206:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788725730.821356:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788725730.823368:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788725730.824996:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788725730.825954:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788725730.826092:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788725730.826616:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788725730.827311:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788725730.827852:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788725730.828012:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788725730.828380:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788725730.828520:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788725730.828659:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788725730.828910:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788725730.829071:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788725730.829408:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788725730.829671:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788725730.829946:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788725730.830233:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788725730.831325:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788725730.836398:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788725730.836450:0:6488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf82419df988 00100000:10000000:3.0:1788725730.836461:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788725730.842114:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788725730.842204:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788725730.842231:0:6488:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788725730.842253:0:6488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788725730.845329:0:6488:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725730.846813:0:6488:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788725731.198910:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725732.219325:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725733.247902:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725734.268530:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725735.291418:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788725736.064362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788725736.064375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788725736.064378:0:36:0:(import.c:65:import_set_state_nolock()) 00000000ff7ef31f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725736.064390:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ff7ef31f using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725736.064412:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f61cbda3 x1875614791372032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725736.064534:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009df8a5cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791371904:0@lo:400: 00000100:00100000:2.0:1788725736.064601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725736.064706:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791371904 00000100:00100000:0.0:1788725736.064715:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791371904 00000100:00100000:0.0:1788725736.064763:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788725736.064771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c5ca013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:3640:x1875614791371904:12345-0@lo:400: 00000100:00100000:0.0:1788725736.064832:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c5ca013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:3640:x1875614791371904:12345-0@lo:400: Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725736.064839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788725736.064997:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009df8a5cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791371904:0@lo:400: 00000100:00100000:1.0:1788725736.065832:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f61cbda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791372032:0@lo:38: 00000100:00100000:1.0:1788725736.065889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725736.069212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372032 00000100:00100000:2.0:1788725736.069229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372032 00000100:00100000:2.0:1788725736.069279:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725736.069286:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cc77e6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791372032:12345-0@lo:38: 00010000:00080000:2.0:1788725736.069315:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1788725736.069372:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa13c582691d36a11 00000004:00100000:2.0:1788725736.069414:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788725736.069540:0:6512:0:(import.c:65:import_set_state_nolock()) 000000007789fac3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725736.069624:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cc77e6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875614791372032:12345-0@lo:38: Request processed in 337us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725736.069632:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788725736.069686:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f61cbda3 x1875614791372032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788725736.069702:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788725736.069710:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788725736.069714:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788725736.069716:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ff7ef31f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788725736.069721:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f61cbda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791372032:0@lo:38: 00010000:00010000:3.0:1788725736.315351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788725736.777776:0:6788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788725737.342335:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788725737.597590:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788725737.597599:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139116a000 from 3 10000000:01000000:0.0:1788725737.597604:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788725737.597785:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.597799:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.597809:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725737.597831:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791372160:0@lo:101: 00000100:00100000:0.0:1788725737.597976:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725737.598025:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6d45a32 going to sleep for 11 seconds 00000100:00100000:0.0:1788725737.598065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372160 00000100:00100000:0.0:1788725737.598073:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372160 00000100:00100000:0.0:1788725737.598114:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788725737.598142:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002371cbef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:6509:x1875614791372160:12345-0@lo:101: 00010000:00010000:0.0:1788725737.598154:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725737.598165:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36a18 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.598184:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36a18 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.598192:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a18 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.598213:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b870b101, rc 0) 00000100:00100000:0.0:1788725737.598249:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002371cbef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6509:x1875614791372160:12345-0@lo:101: Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725737.598256:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788725737.598302:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791372160:0@lo:101: 00010000:00010000:0.0:1788725737.598314:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.598322:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725737.598367:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791372288:0@lo:256: 00000100:00100000:0.0:1788725737.599273:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725737.599309:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6d45a32 going to sleep for 11 seconds 00000100:00100000:0.0:1788725737.599331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372288 00000100:00100000:0.0:1788725737.599337:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372288 00000100:00100000:0.0:1788725737.599370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788725737.599377:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002872cfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6509:x1875614791372288:12345-0@lo:256: 20000000:01000000:0.0:1788725737.601034:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788725737.601051:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788725737.601054:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788725737.601187:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002872cfc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:6509:x1875614791372288:12345-0@lo:256: Request processed in 1808us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725737.601198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788725737.601262:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791372288:0@lo:256: 10000000:01000000:0.0:1788725737.601308:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725737.601321:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725737.601330:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1788725737.765381:0:6840:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788725737.765789:0:6840:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788725738.363476:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725739.388060:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725740.413328:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788725741.115893:0:6942:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788725741.116106:0:6942:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788725741.179628:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791372544:0@lo:400: 00000100:00100000:2.0:1788725741.179724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725741.179868:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791372416:0@lo:400: 00000100:00100000:0.0:1788725741.179912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725741.180431:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372416 00000100:00100000:2.0:1788725741.180441:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372416 00000100:00100000:2.0:1788725741.180512:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725741.180522:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005fc525e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3641:x1875614791372416:12345-0@lo:400: 00000100:00100000:2.0:1788725741.180589:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005fc525e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3641:x1875614791372416:12345-0@lo:400: Request processed in 69us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725741.180597:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725741.180651:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791372416:0@lo:400: 00000100:00100000:3.0:1788725741.180923:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372544 00000100:00100000:3.0:1788725741.180929:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372544 00000100:00100000:3.0:1788725741.180968:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725741.180975:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b30fe07a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791372544:12345-0@lo:400: 00000100:00100000:3.0:1788725741.181039:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b30fe07a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791372544:12345-0@lo:400: Request processed in 64us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725741.181045:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788725741.181346:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005df149ab x1875614791372544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725741.181363:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791372544:0@lo:400: 00010000:00010000:1.0:1788725741.463434:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725742.460504:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725743.484422:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725744.512736:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725745.537973:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725746.301709:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791372672:0@lo:400: 00000100:00100000:0.0:1788725746.301824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725746.301931:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791372800:0@lo:400: 00000100:00100000:0.0:1788725746.301960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725746.302003:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372672 00000100:00100000:0.0:1788725746.302011:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372672 00000100:00100000:0.0:1788725746.302066:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788725746.302076:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002372baa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3639:x1875614791372672:12345-0@lo:400: 00000100:00100000:0.0:1788725746.302148:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002372baa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3639:x1875614791372672:12345-0@lo:400: Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725746.302156:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788725746.302199:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372800 00000100:00100000:0.0:1788725746.302203:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372800 00000100:00100000:0.0:1788725746.302251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725746.302256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000efbac4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791372800:12345-0@lo:400: 00000100:00100000:0.0:1788725746.302294:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000efbac4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791372800:12345-0@lo:400: Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725746.302300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788725746.302340:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000367b6156 x1875614791372800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725746.302356:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791372800:0@lo:400: 00000100:00100000:0.0:1788725746.302383:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791372672:0@lo:400: 00010000:00010000:2.0:1788725746.555968:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725747.587718:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725748.603471:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725749.632430:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725750.651306:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725751.420378:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725751.420410:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791372928:0@lo:400: 00000100:00100000:0.0:1788725751.420507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725751.420600:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791373056:0@lo:400: 00000100:00100000:0.0:1788725751.420632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725751.420682:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791372928 00000100:00100000:0.0:1788725751.420691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791372928 00000100:00100000:0.0:1788725751.420757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788725751.420766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000267c6513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3640:x1875614791372928:12345-0@lo:400: 00000100:00100000:0.0:1788725751.420823:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000267c6513 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:3640:x1875614791372928:12345-0@lo:400: Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725751.420830:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788725751.420891:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791372928:0@lo:400: 00000100:00100000:3.0:1788725751.425277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373056 00000100:00100000:3.0:1788725751.425299:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373056 00000100:00100000:3.0:1788725751.425384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725751.425395:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f04a7009 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791373056:12345-0@lo:400: 00000100:00100000:3.0:1788725751.425542:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f04a7009 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791373056:12345-0@lo:400: Request processed in 149us (4909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725751.425571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788725751.425635:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000367b6156 x1875614791373056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725751.425654:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791373056:0@lo:400: 00010000:00010000:3.0:1788725751.677391:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788725752.680617:0:7440:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:0.0:1788725752.680621:0:7440:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788725752.680623:0:7440:0:(obd_mount.c:940:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788725752.680773:0:7440:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001d83eed7 00000020:01000004:0.0:1788725752.680793:0:7440:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788725752.680803:0:7440:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788725752.680817:0:7440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000989caefb) 00000020:00000080:0.0:1788725752.680831:0:7440:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788725752.699650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788725752.759637:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788725752.759750:0:7440:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788725752.816509:0:7440:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788725752.816767:0:7440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788725752.816777:0:7440:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788725752.816789:0:7440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36a2d 00000020:01000004:1.0:1788725752.816795:0:7440:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788725752.816817:0:7440:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788725752.816820:0:7440:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788725752.816825:0:7440:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788725752.816852:0:7440:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788725752.816855:0:7440:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788725752.866577:0:7440:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788725752.866614:0:7440:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788725752.866618:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788725752.866620:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788725752.866621:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725752.866622:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725752.866623:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725752.866625:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725752.866626:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725752.866627:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725752.866628:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725752.866629:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725752.866631:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725752.866634:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788725752.866637:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788725752.866638:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788725752.866639:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725752.866640:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725752.866641:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725752.866642:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725752.866647:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725752.866648:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725752.866649:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725752.866649:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725752.866650:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725752.866675:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788725752.866690:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000506b9b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791373184:0@lo:253: 00000100:00100000:1.0:1788725752.866782:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725752.866856:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5d757d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.871500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373184 00000100:00100000:2.0:1788725752.871514:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373184 00000100:00100000:1.0:1788725752.878377:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788725752.878392:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083a20016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791373184:12345-0@lo:253: 20000000:01000000:1.0:1788725752.878433:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788725752.878439:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788725752.878444:0:6504:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788725752.878447:0:6504:0:(mgs_llog.c:3615:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788725752.878494:0:6504:0:(mgs_llog.c:3175:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788725752.878783:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725752.878953:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788725752.878968:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788725752.879004:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788725752.879024:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788725752.879041:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788725752.879461:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788725752.879473:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788725752.879487:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788725752.879492:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788725752.879502:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788725752.879506:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788725752.879517:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788725752.879530:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788725752.879639:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788725752.879650:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788725752.879674:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788725752.879682:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788725752.879695:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788725752.879825:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788725752.879845:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788725752.879852:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788725752.879865:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788725752.879879:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788725752.879957:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788725752.880036:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788725752.880045:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788725752.880821:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788725752.880865:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788725752.880885:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788725752.884818:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788725752.884958:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788725752.885000:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788725752.885005:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788725752.885061:0:6504:0:(mgs_llog.c:3312:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788725752.885316:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788725752.896558:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788725752.897178:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788725752.897208:0:6504:0:(mgs_llog.c:3358:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:3.0:1788725752.897211:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788725752.897229:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788725752.897235:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788725752.897248:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788725752.897253:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788725752.897268:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788725752.897275:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788725752.897289:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788725752.897305:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788725752.897360:0:6504:0:(mgs_llog.c:3438:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788725752.897370:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788725752.897959:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788725752.898345:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788725752.898367:0:6504:0:(mgs_llog.c:3496:mgs_write_log_osp_to_mdt()) add nid 192.168.203.112@tcp for mdt 20000000:01000000:0.0:1788725752.898368:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:0.0:1788725752.898383:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788725752.898389:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788725752.898401:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788725752.898406:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:0.0:1788725752.898418:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788725752.898424:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788725752.898436:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788725752.898450:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788725752.898471:0:6504:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788725752.898474:0:6504:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788725752.898478:0:6504:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788725752.898523:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788725752.898526:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788725752.898925:0:7448:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788725752.898946:0:7448:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788725752.898960:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788725752.899151:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788725752.899173:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788725752.899194:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788725752.899206:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788725752.899207:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788725752.899592:0:7449:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788725752.899625:0:7449:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788725752.899640:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788725752.899851:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788725752.899872:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788725752.899892:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788725752.899900:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788725752.899902:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788725752.900369:0:7450:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788725752.900390:0:7450:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788725752.900404:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788725752.900532:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788725752.900566:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788725752.900583:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788725752.900596:0:6504:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788725752.900599:0:6504:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788725752.900604:0:6504:0:(mgs_llog.c:5075:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788725752.900609:0:6504:0:(mgs_llog.c:1382:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788725752.904518:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788725752.904681:0:6504:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788725752.925656:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788725752.925752:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925773:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36962 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925780:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3697e expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925786:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925792:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925837:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.925867:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725752.925882:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ea6d19a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373312:0@lo:104: 00000100:00100000:1.0:1788725752.925956:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725752.926014:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.926022:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 12 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725752.926030:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b449c6b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373440:0@lo:104: 00000100:00100000:1.0:1788725752.926052:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725752.926091:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.926097:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 12 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725752.926104:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008562d975 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373568:0@lo:104: 00000100:00100000:1.0:1788725752.926157:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725752.926173:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c719c967 going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.926458:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373312 00000100:00100000:2.0:1788725752.926467:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373312 00000100:00100000:2.0:1788725752.926500:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373440 00000100:00100000:2.0:1788725752.926510:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373440 00000100:00100000:2.0:1788725752.926522:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373568 00000100:00100000:2.0:1788725752.926524:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373568 00000100:00100000:2.0:1788725752.926537:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725752.926544:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c54cf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6504:x1875614791373312:12345-0@lo:104: 00010000:00010000:2.0:1788725752.926555:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926617:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725752.926622:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c54cf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6504:x1875614791373312:12345-0@lo:104: Request processed in 78us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.926629:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725752.926645:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725752.926651:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f77c372f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791373440:12345-0@lo:104: 00010000:00010000:2.0:1788725752.926657:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926692:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788725752.926696:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f77c372f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791373440:12345-0@lo:104: Request processed in 47us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.926712:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725752.926725:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725752.926730:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce6c4f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791373568:12345-0@lo:104: 00010000:00010000:2.0:1788725752.926745:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926772:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788725752.926777:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce6c4f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791373568:12345-0@lo:104: Request processed in 48us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.926788:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788725752.926806:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788725752.926811:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926818:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001deea6e1 already unused, calling callback (00000000f98095d5) 10000000:00010000:2.0:1788725752.926822:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926830:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725752.926836:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.926843:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725752.926870:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.926878:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725752.926973:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725752.927080:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927088:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d369ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369f5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927102:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725752.927105:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927149:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002456faeb already unused, calling callback (00000000f98095d5) 10000000:00010000:2.0:1788725752.927152:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927157:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725752.927162:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.927167:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725752.927181:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927186:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725752.927201:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927207:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000002456faeb/0xa13c582691d36962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36969 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927217:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725752.927219:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725752.927220:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725752.927237:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725752.927249:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791373696:0@lo:103: 00000100:00100000:2.0:1788725752.927278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.927306:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000da638e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791373824:0@lo:103: 00000100:00100000:2.0:1788725752.927339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.927371:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373696 00000100:00100000:2.0:1788725752.927376:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373696 00010000:00010000:2.0:1788725752.927393:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 13 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.927414:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373824 00000100:00100000:2.0:1788725752.927417:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373824 00010000:00010000:2.0:1788725752.927427:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 14 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.927439:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725752.927445:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8218f6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:3638:x1875614791373696:12345-0@lo:103: 00010000:00010000:2.0:1788725752.927453:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725752.927457:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 14 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927466:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 14 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927480:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725752.927505:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8218f6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:3638:x1875614791373696:12345-0@lo:103: Request processed in 61us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.927510:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788725752.927524:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725752.927529:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bee40c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:3640:x1875614791373824:12345-0@lo:103: 00010000:00010000:2.0:1788725752.927536:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725752.927540:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 13 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927558:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 13 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.927567:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725752.927595:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bee40c71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:3640:x1875614791373824:12345-0@lo:103: Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.927600:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725752.927636:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000da638e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791373824:0@lo:103: 00000100:00100000:2.0:1788725752.927660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791373696:0@lo:103: 00010000:00010000:0.0:1788725752.929858:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee63c0f7/0xa13c582691d369f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d369ee expref: 12 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725752.929881:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ea6d19a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373312:0@lo:104: 00000100:00100000:0.0:1788725752.929891:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b449c6b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373440:0@lo:104: 00010000:00010000:0.0:1788725752.929898:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e57d39eb/0xa13c582691d36969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36962 expref: 11 pid: 6505 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725752.929906:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008562d975 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791373568:0@lo:104: 00010000:00010000:0.0:1788725752.929928:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725752.930307:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725752.930311:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725752.930313:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725752.930349:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.930360:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c410a8bc already unused, calling callback (00000000f98095d5) 10000000:00010000:0.0:1788725752.930363:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.930372:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725752.930388:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725752.930394:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725752.930442:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.930448:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725752.930468:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.930475:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 00000000c410a8bc/0xa13c582691d3697e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36985 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.930490:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725752.930491:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725752.930493:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725752.930587:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791373952:0@lo:103: 00000100:00100000:1.0:1788725752.930646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725752.930800:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791373952 00000100:00100000:0.0:1788725752.930808:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791373952 00010000:00010000:0.0:1788725752.930834:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 11 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725752.930871:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788725752.930879:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db48899e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:3641:x1875614791373952:12345-0@lo:103: 00010000:00010000:0.0:1788725752.930901:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725752.930906:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 11 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.933840:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 11 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.933902:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be5cb84f/0xa13c582691d36985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d3697e expref: 11 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.933922:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.933929:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934189:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934199:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934210:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934216:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934222:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edb716c2 already unused, calling callback (00000000f88379cb) 00010000:00010000:1.0:1788725752.934225:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934232:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934250:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725752.934264:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725752.934347:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db48899e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:3641:x1875614791373952:12345-0@lo:103: Request processed in 3467us (3699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725752.934362:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788725752.934510:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008036b7d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791373952:0@lo:103: 00010000:00010000:0.0:1788725752.934663:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.934672:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.934677:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edb716c2/0xa13c582691d36a34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725752.934694:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788725752.945550:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083a20016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:7440:x1875614791373184:12345-0@lo:253: Request processed in 67152us (78758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.945566:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788725752.945660:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000506b9b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791373184:0@lo:253: 10000000:01000000:0.0:1788725752.945676:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788725752.945679:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788725752.945681:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788725752.945683:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788725752.945684:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788725752.945685:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788725752.945686:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788725752.945688:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788725752.945689:0:7440:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788725752.945691:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788725752.945692:0:7440:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788725752.945728:0:7440:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001d83eed7 from lustre-MDT0001 10000000:01000000:0.0:1788725752.945781:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788725752.945784:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788725752.945790:0:7440:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b13a96d0000 local copy 10000000:01000000:0.0:1788725752.945794:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788725752.945827:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.945839:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.945847:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725752.945865:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7f4019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374080:0@lo:101: 00000100:00100000:0.0:1788725752.945916:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725752.945958:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1f5c6d going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.946011:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374080 00000100:00100000:2.0:1788725752.946019:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374080 00000100:00100000:2.0:1788725752.946065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788725752.946083:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b5ab12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:7440:x1875614791374080:12345-0@lo:101: 00010000:00010000:2.0:1788725752.946097:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725752.946109:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c1db222/0xa13c582691d36a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36a3b expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.946153:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c1db222/0xa13c582691d36a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36a3b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.946163:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c1db222/0xa13c582691d36a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a3b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.946170:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c1db222, rc 0) 00000100:00100000:2.0:1788725752.946209:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b5ab12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:7440:x1875614791374080:12345-0@lo:101: Request processed in 127us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.946215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725752.946859:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7f4019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374080:0@lo:101: 00010000:00010000:0.0:1788725752.946875:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.946885:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725752.947006:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7f4019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374208:0@lo:501: 00000100:00100000:0.0:1788725752.947042:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725752.947080:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000002e1f5c6d going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.947151:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374208 00000100:00100000:2.0:1788725752.947156:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374208 00000100:00100000:2.0:1788725752.947189:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788725752.947197:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003936aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:7440:x1875614791374208:12345-0@lo:501: 00000100:00100000:2.0:1788725752.947266:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003936aea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:7440:x1875614791374208:12345-0@lo:501: Request processed in 70us (224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725752.947273:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788725752.947309:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7f4019f pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374208:0@lo:501: 10000000:01000000:2.0:1788725752.947322:0:7440:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788725752.947341:0:7440:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788725752.947345:0:7440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947352:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947358:0:7440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947375:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788725752.947398:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b13bd660800 00010000:00010000:2.0:1788725752.947408:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725752.947413:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947435:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009415f912 already unused, calling callback (00000000f98095d5) 10000000:00010000:2.0:1788725752.947438:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947445:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725752.947451:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.947456:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725752.947474:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947481:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725752.947498:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947503:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000009415f912/0xa13c582691d36a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36a42 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947518:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725752.947520:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725752.947521:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725752.947528:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725752.947538:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791374336:0@lo:103: 00000100:00100000:2.0:1788725752.947567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.947597:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374336 00000100:00100000:2.0:1788725752.947601:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374336 00000100:00100000:2.0:1788725752.947639:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725752.947646:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da638e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:3639:x1875614791374336:12345-0@lo:103: 00010000:00010000:2.0:1788725752.947655:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725752.947667:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c1db222/0xa13c582691d36a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36a3b expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947680:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725752.947721:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da638e4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:3639:x1875614791374336:12345-0@lo:103: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.947727:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725752.947769:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791374336:0@lo:103: 10000000:01000000:2.0:1788725752.947787:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788725752.947794:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b13a96d0000 10000000:01000000:2.0:1788725752.947796:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788725752.947799:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b13a96d0000 from 1 10000000:01000000:2.0:1788725752.947801:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788725752.947820:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947827:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.947834:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.947844:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374464:0@lo:101: 00000100:00100000:2.0:1788725752.947870:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.947881:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:0.0:1788725752.948389:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374464 00000100:00100000:0.0:1788725752.948396:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374464 00000100:00100000:0.0:1788725752.948436:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725752.948443:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee098e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:7440:x1875614791374464:12345-0@lo:101: 00010000:00010000:0.0:1788725752.948462:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725752.948473:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fd26c82/0xa13c582691d36a50 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36a49 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.948490:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fd26c82/0xa13c582691d36a50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36a49 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.948499:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fd26c82/0xa13c582691d36a50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a49 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.948506:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fd26c82, rc 0) 00000100:00100000:0.0:1788725752.948538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee098e3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:7440:x1875614791374464:12345-0@lo:101: Request processed in 96us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725752.948545:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788725752.948620:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374464:0@lo:101: 00010000:00010000:2.0:1788725752.948638:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.948646:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.948662:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788725752.948680:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.948687:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000cd076e14/0xa13c582691d36a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.948696:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b13bd660800 10000000:01000000:2.0:1788725752.948700:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788725752.948712:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b13bd660800 from 1 10000000:01000000:2.0:1788725752.948714:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788725752.948728:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.948745:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.948752:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.948765:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374592:0@lo:101: 00000100:00100000:2.0:1788725752.948791:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.948804:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:0.0:1788725752.949046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374592 00000100:00100000:0.0:1788725752.949051:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374592 00000100:00100000:0.0:1788725752.949095:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725752.949102:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010bf238c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:7440:x1875614791374592:12345-0@lo:101: 00010000:00010000:0.0:1788725752.949110:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725752.949138:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082ed23da/0xa13c582691d36a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36a57 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.949152:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082ed23da/0xa13c582691d36a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36a57 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.949160:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082ed23da/0xa13c582691d36a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a57 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725752.949166:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082ed23da, rc 0) 00000100:00100000:0.0:1788725752.949202:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010bf238c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:7440:x1875614791374592:12345-0@lo:101: Request processed in 101us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725752.949208:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725752.949834:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374592:0@lo:101: 00010000:00010000:2.0:1788725752.949854:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.949862:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.949874:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788725752.949895:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.949902:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000e501c0e2/0xa13c582691d36a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725752.949908:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788725752.949912:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725752.949916:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b13bd660800 10000000:01000000:2.0:1788725752.949918:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788725752.949922:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788725752.949924:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788725752.949941:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.949947:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.949954:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.949967:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374720:0@lo:101: 00000100:00100000:2.0:1788725752.949998:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.950030:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374720 00000100:00100000:2.0:1788725752.950033:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374720 00000100:00100000:2.0:1788725752.950062:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788725752.950545:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011a39545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+11:7440:x1875614791374720:12345-0@lo:101: 00010000:00010000:2.0:1788725752.950560:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725752.950572:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3c8ccb1/0xa13c582691d36a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36a65 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.950589:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3c8ccb1/0xa13c582691d36a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36a65 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.950597:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3c8ccb1/0xa13c582691d36a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a65 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.950603:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3c8ccb1, rc 0) 00000100:00100000:2.0:1788725752.950636:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011a39545 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791374720:12345-0@lo:101: Request processed in 567us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.950643:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788725752.950681:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.950696:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374720:0@lo:101: 00010000:00010000:2.0:1788725752.950785:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725752.950793:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725752.950881:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374848:0@lo:501: 00000100:00100000:2.0:1788725752.951042:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.951321:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:1.0:1788725752.959911:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374848 00000100:00100000:1.0:1788725752.959928:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374848 00000100:00100000:1.0:1788725752.960045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788725752.960056:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085c84fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791374848:12345-0@lo:501: 00000100:00100000:1.0:1788725752.960245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085c84fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791374848:12345-0@lo:501: Request processed in 191us (9202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725752.960254:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788725752.972941:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374848:0@lo:501: 00000100:00100000:2.0:1788725752.973006:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374976:0@lo:503: 00000100:00100000:2.0:1788725752.973102:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.973162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791374976 00000100:00100000:2.0:1788725752.973169:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791374976 00000100:00100000:2.0:1788725752.973215:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725752.973224:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d8fe368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791374976:12345-0@lo:503: 00000100:00100000:2.0:1788725752.974053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d8fe368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791374976:12345-0@lo:503: Request processed in 828us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725752.974063:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725752.974152:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:2.0:1788725752.974170:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791374976:0@lo:503: 00000040:00080000:2.0:1788725752.974421:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725752.974513:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375104:0@lo:502: 00000100:00100000:2.0:1788725752.978052:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725752.979305:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000133ed457 going to sleep for 11 seconds 00000100:00100000:1.0:1788725752.980647:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375104 00000100:00100000:1.0:1788725752.980662:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375104 00000100:00100000:1.0:1788725752.980920:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725752.980932:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aad64317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791375104:12345-0@lo:502: 00000100:00100000:1.0:1788725752.981137:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aad64317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791375104:12345-0@lo:502: Request processed in 207us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725752.981144:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725752.981214:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000489ea725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375104:0@lo:502: 00000040:00080000:1.0:1788725752.981452:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788725752.981483:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788725752.981499:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788725752.981513:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788725752.981545:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788725752.981563:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788725752.981576:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788725752.981587:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788725752.981598:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788725752.981611:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788725752.981624:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788725752.981637:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788725752.981650:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788725752.981664:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788725752.981693:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788725752.981708:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788725752.981720:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788725752.981747:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788725752.981762:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788725752.981775:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788725752.981787:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788725752.981801:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788725752.981813:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788725752.981847:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000898dabf3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375232:0@lo:502: 00000100:00100000:1.0:1788725752.981905:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725752.981939:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375232 00000100:00100000:1.0:1788725752.981945:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375232 00000100:00100000:1.0:1788725752.981974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725752.981981:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002315964a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791375232:12345-0@lo:502: 00000100:00100000:1.0:1788725752.982055:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002315964a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791375232:12345-0@lo:502: Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725752.982062:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725752.982105:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c719c967 going to sleep for 11 seconds 00000100:00100000:1.0:1788725752.982141:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000898dabf3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375232:0@lo:502: 00000040:00080000:1.0:1788725752.982181:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788725752.982188:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788725752.997375:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725752.997392:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725752.997394:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788725752.997400:0:7454:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788725752.997404:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788725752.997418:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000cb54eba7) 00000020:00000080:3.0:1788725752.997439:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788725752.997445:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788725752.998156:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788725752.998167:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36a7a 00000020:00000080:3.0:1788725752.998410:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788725752.998417:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725752.998421:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725752.998423:0:7454:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788725752.998426:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725752.998430:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725752.998431:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788725752.998434:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788725752.998444:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003580c014) 00000020:00000080:3.0:1788725752.998455:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788725752.998465:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788725752.998466:0:7454:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788725752.998469:0:7454:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788725752.998474:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788725752.998537:0:7454:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001d83eed7 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788725752.998552:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000034244809) 00000020:00000080:3.0:1788725752.998561:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788725752.998638:0:7454:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788725752.998644:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36a8f 00000020:00000080:3.0:1788725752.998758:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788725752.998766:0:7454:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788725752.998770:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa13c582691d36a96 00080000:01000000:3.0:1788725752.998775:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788725752.998778:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36a9d 00080000:10000000:3.0:1788725752.999492:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788725752.999637:0:7454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788725753.177562:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788725753.177800:0:7454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788725753.180652:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788725753.181302:0:7454:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788725753.197868:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788725753.197882:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725753.197898:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725753.197901:0:7454:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788725753.197905:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725753.197910:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725753.197912:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788725753.197914:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788725753.197919:0:7454:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:3.0:1788725753.197945:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788725753.197970:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000024c36b47) 00000020:00000080:3.0:1788725753.197993:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788725753.198003:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788725753.198084:0:7454:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788725753.198091:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788725753.198097:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36aab 00010000:00080000:3.0:1788725753.198171:0:7454:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007037aff9@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788725753.215692:0:7454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788725753.221975:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788725753.221994:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788725753.222040:0:7454:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788725753.222061:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36ab2 00000100:00080000:1.0:1788725753.222538:0:7454:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788725753.222612:0:7454:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000007037aff9 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788725753.222649:0:7454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000898dabf3 x1875614791375360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788725753.222753:0:7454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788725753.222803:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000898dabf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791375360:0@lo:38: 00000100:00100000:2.0:1788725753.222876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788725753.222976:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725753.222981:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.222982:0:7454:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788725753.222985:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788725753.222988:0:7454:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788725753.222990:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788725753.222991:0:7454:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788725753.222999:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788725753.223001:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.223002:0:7454:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788725753.223005:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725753.223009:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.223010:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788725753.223014:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788725753.223053:0:7454:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788725753.223071:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725753.223074:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.223076:0:7454:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788725753.223078:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725753.223081:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.223082:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788725753.223085:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788725753.223087:0:7454:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788725753.223112:0:7454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725753.223131:0:7454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725753.223133:0:7454:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788725753.223136:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788725753.223249:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375360 00000100:00100000:2.0:1788725753.223258:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375360 00000100:00100000:1.0:1788725753.223291:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791375488:0@lo:400: 00000100:00100000:1.0:1788725753.223325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.223374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375488 00000100:00100000:1.0:1788725753.223378:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375488 00000100:00100000:1.0:1788725753.223418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788725753.223426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000937c7cd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791375488:12345-0@lo:400: 00000100:00100000:2.0:1788725753.223467:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725753.223474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000832fdbe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791375360:12345-0@lo:38: 00000100:00100000:1.0:1788725753.223485:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000937c7cd6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791375488:12345-0@lo:400: Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.223493:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788725753.223498:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1788725753.223533:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36ab9 00010000:00080000:1.0:1788725753.223533:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000025340e6b x1875614791375488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00100000:2.0:1788725753.223549:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788725753.223554:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788725753.224808:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791375488:0@lo:400: 00000020:01000000:1.0:1788725753.224843:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788725753.224883:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788725753.224894:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.224904:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000095f6bbf9/0xa13c582691d36a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725753.224911:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b13bd660800 from 1 10000000:01000000:1.0:1788725753.224914:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788725753.224942:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.224948:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.224957:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725753.224973:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375616:0@lo:101: 00000100:00100000:1.0:1788725753.225017:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.225053:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375616 00000100:00100000:1.0:1788725753.225058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375616 00000100:00100000:1.0:1788725753.225093:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725753.225101:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061ab7983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+12:7440:x1875614791375616:12345-0@lo:101: 00010000:00010000:1.0:1788725753.225112:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725753.225140:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ac0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.225167:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.225176:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.225184:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000826ec554, rc 0) 00000100:00100000:1.0:1788725753.225213:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061ab7983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:7440:x1875614791375616:12345-0@lo:101: Request processed in 114us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.225219:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725753.225475:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5d757d0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.225493:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375616:0@lo:101: 00010000:00010000:1.0:1788725753.225505:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.225514:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725753.226332:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375744:0@lo:256: 00000100:00100000:1.0:1788725753.226373:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.226399:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5d757d0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725753.226501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375744 00000100:00100000:3.0:1788725753.226508:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375744 00000100:00100000:3.0:1788725753.226553:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788725753.226561:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a7c26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:7440:x1875614791375744:12345-0@lo:256: 20000000:01000000:3.0:1788725753.226577:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788725753.226594:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788725753.226597:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788725753.226820:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a7c26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:7440:x1875614791375744:12345-0@lo:256: Request processed in 259us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725753.226828:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725753.226897:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025340e6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375744:0@lo:256: 10000000:01000000:0.0:1788725753.227512:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725753.227529:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.227539:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725753.227558:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b13bd660800 from 1 10000000:01000000:0.0:1788725753.227560:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788725753.227585:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.227592:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.227599:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725753.227612:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035f39293 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375872:0@lo:101: 00000100:00100000:0.0:1788725753.227648:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.227671:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ef6ad28 going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.227864:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791375872 00000100:00100000:1.0:1788725753.227870:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791375872 00000100:00100000:1.0:1788725753.227911:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725753.227919:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c79aeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:7440:x1875614791375872:12345-0@lo:101: 00010000:00010000:1.0:1788725753.227930:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725753.227940:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ace expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.228722:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ace expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.228730:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ace expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.228747:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000221613e7, rc 0) 00000100:00100000:1.0:1788725753.228856:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c79aeb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791375872:12345-0@lo:101: Request processed in 938us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.228863:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788725753.230688:0:6515:0:(import.c:65:import_set_state_nolock()) 000000009845dc56 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725753.230779:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000832fdbe6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791375360:12345-0@lo:38: Request processed in 7302us (7901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.230788:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725753.230918:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788725753.230927:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788725753.230933:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788725753.230938:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788725753.230940:0:3637:0:(import.c:65:import_set_state_nolock()) 000000007037aff9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788725753.230955:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000898dabf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791375360:0@lo:38: 00000100:00100000:1.0:1788725753.231052:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725753.231202:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035f39293 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791375872:0@lo:101: 00010000:00010000:0.0:1788725753.231221:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.231243:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725753.231482:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035f39293 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376128:0@lo:501: 00000100:00100000:0.0:1788725753.231520:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.231589:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ef6ad28 going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.231682:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c87eb34e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791376000:0@lo:41: 00000100:00100000:1.0:1788725753.231712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725753.231791:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376000 00000100:00100000:3.0:1788725753.231797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376000 00000100:00100000:3.0:1788725753.231838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725753.231847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898dabf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875614791376000:12345-0@lo:41: 00000004:00000024:3.0:1788725753.231871:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788725753.231916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898dabf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875614791376000:12345-0@lo:41: Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725753.231922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725753.231984:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c87eb34e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791376000:0@lo:41: 00000100:00100000:2.0:1788725753.232061:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376128 00000100:00100000:2.0:1788725753.232065:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376128 00000100:00100000:2.0:1788725753.233667:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725753.233685:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e64e6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791376128:12345-0@lo:501: 00000100:00100000:2.0:1788725753.233903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e64e6c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791376128:12345-0@lo:501: Request processed in 226us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.233912:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725753.234486:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035f39293 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376128:0@lo:501: 00000100:00100000:1.0:1788725753.234537:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aab8d635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376256:0@lo:503: 00000100:00100000:1.0:1788725753.234662:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.234748:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c719c967 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.234844:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376256 00000100:00100000:2.0:1788725753.234851:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376256 00000100:00100000:2.0:1788725753.234894:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788725753.234902:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d853cd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791376256:12345-0@lo:503: 00000040:00080000:2.0:1788725753.234940:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725753.234980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d853cd5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791376256:12345-0@lo:503: Request processed in 80us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.234987:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725753.235065:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aab8d635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376256:0@lo:503: 00000040:00080000:1.0:1788725753.235477:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725753.235529:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788725753.235676:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725753.236622:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788725753.236780:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788725753.236808:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725753.236865:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.236877:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725753.236934:0:7440:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788725753.236944:0:7440:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b13bd660800 10000000:01000000:2.0:1788725753.236947:0:7440:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b13bd660800 10000000:01000000:2.0:1788725753.236952:0:7440:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725753.236957:0:7440:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b13bd660800 from 1 10000000:01000000:2.0:1788725753.236960:0:7440:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725753.236991:0:7440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.236999:0:7440:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.237008:0:7440:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725753.237027:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d603fc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376384:0@lo:101: 00000100:00100000:2.0:1788725753.237077:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.237150:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000005425a54d going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.237206:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376384 00000100:00100000:1.0:1788725753.237212:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376384 00000100:00100000:1.0:1788725753.237259:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788725753.237278:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e9532a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:7440:x1875614791376384:12345-0@lo:101: 00010000:00010000:1.0:1788725753.237289:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725753.237301:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c2aada6/0xa13c582691d36ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36adc expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.237322:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c2aada6/0xa13c582691d36ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36adc expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.237330:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c2aada6/0xa13c582691d36ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36adc expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.237338:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c2aada6, rc 0) 00000100:00100000:1.0:1788725753.237372:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e9532a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376384:12345-0@lo:101: Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.237379:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725753.237613:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d603fc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376384:0@lo:101: 00010000:00010000:0.0:1788725753.237629:0:7440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.237636:0:7440:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725753.237715:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376512:0@lo:501: 00000100:00100000:0.0:1788725753.237754:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.237782:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000021720d4 going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.237834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376512 00000100:00100000:1.0:1788725753.237839:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376512 00000100:00100000:1.0:1788725753.237869:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725753.237875:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b528769f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376512:12345-0@lo:501: 00000100:00100000:1.0:1788725753.237972:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b528769f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376512:12345-0@lo:501: Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.237978:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725753.238081:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376512:0@lo:501: 00000100:00100000:0.0:1788725753.238106:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376640:0@lo:503: 00000100:00100000:0.0:1788725753.238174:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.238191:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000021720d4 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.238260:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376640 00000100:00100000:2.0:1788725753.238274:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376640 00000100:00100000:2.0:1788725753.238300:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788725753.238306:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f98b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376640:12345-0@lo:503: 00000100:00100000:2.0:1788725753.238388:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f98b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376640:12345-0@lo:503: Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.238395:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725753.238512:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376640:0@lo:503: 00000040:00080000:0.0:1788725753.238856:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788725753.238934:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376768:0@lo:502: 00000100:00100000:0.0:1788725753.238969:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.239007:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 00000000021720d4 going to sleep for 11 seconds 00000100:00100000:1.0:1788725753.239079:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376768 00000100:00100000:1.0:1788725753.239084:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376768 00000100:00100000:1.0:1788725753.239132:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788725753.239139:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002134a9a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376768:12345-0@lo:502: 00000100:00100000:1.0:1788725753.239222:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002134a9a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376768:12345-0@lo:502: Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.239228:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788725753.239336:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cb076af pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376768:0@lo:502: 00000040:00080000:1.0:1788725753.239510:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788725753.239536:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788725753.239629:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788725753.239645:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788725753.239657:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788725753.239668:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788725753.239680:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788725753.239692:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788725753.239706:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788725753.239718:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788725753.239743:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788725753.239758:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788725753.239772:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788725753.239785:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788725753.239797:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788725753.239808:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788725753.239820:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788725753.239833:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788725753.239845:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788725753.239857:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788725753.239869:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788725753.239882:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788725753.239897:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788725753.239923:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788725753.240395:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788725753.240414:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788725753.240426:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788725753.240438:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788725753.240472:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aab8d635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376896:0@lo:502: 00000100:00100000:1.0:1788725753.240526:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.240663:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 000000007330c723 going to sleep for 11 seconds 00000100:00100000:0.0:1788725753.243049:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791376896 00000100:00100000:0.0:1788725753.243065:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791376896 00000100:00100000:0.0:1788725753.243138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788725753.243147:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0824bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376896:12345-0@lo:502: 00000100:00100000:0.0:1788725753.243446:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0824bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791376896:12345-0@lo:502: Request processed in 300us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725753.243455:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788725753.243565:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aab8d635 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791376896:0@lo:502: 00000040:00080000:2.0:1788725753.243656:0:7440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788725753.243670:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788725753.244335:0:7460:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788725753.244363:0:7460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c0739d27) 00000020:00000080:2.0:1788725753.244390:0:7460:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788725753.244475:0:7460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001d83eed7 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788725753.244480:0:7460:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001d83eed7 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788725753.244482:0:7460:0:(obd_mount.c:721:lustre_put_lsi()) put 000000001d83eed7 3 00010000:00080000:2.0:1788725753.244511:0:7460:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ba596209@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788725753.249092:0:7460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788725753.249565:0:7460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788725753.249612:0:7460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788725753.249625:0:7460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa13c582691d36af1 00000100:00080000:2.0:1788725753.249636:0:7460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788725753.249641:0:7460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ba596209 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788725753.249675:0:7460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000bf01aa3 x1875614791377024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788725753.249780:0:7460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788725753.249875:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000bf01aa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791377024:0@lo:38: 00000100:00100000:1.0:1788725753.249945:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.250004:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377024 00000100:00100000:1.0:1788725753.250010:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377024 00000100:00100000:1.0:1788725753.250040:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725753.250046:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e720fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875614791377024:12345-0@lo:38: 00010000:00080000:1.0:1788725753.250067:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788725753.250099:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa13c582691d36af8 00000004:00100000:1.0:1788725753.250112:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788725753.250193:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000fc4a1d22 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725753.250238:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e720fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875614791377024:12345-0@lo:38: Request processed in 190us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.250245:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788725753.250458:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000bf01aa3 x1875614791377024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725753.250468:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788725753.250475:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788725753.250481:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788725753.250485:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788725753.250498:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ba596209 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788725753.250504:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000bf01aa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791377024:0@lo:38: 00000040:00080000:3.0:1788725753.250882:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788725753.251052:0:7461:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1788725753.251156:0:7440:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788725753.251188:0:7440:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788725753.251204:0:7440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725753.251213:0:7440:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000007c1db222/0xa13c582691d36adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788725753.251276:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788725753.251280:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788725753.251281:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725753.251282:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725753.251283:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725753.251285:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725753.251286:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725753.251287:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725753.251289:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725753.251290:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725753.251292:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788725753.251296:0:7440:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788725753.251298:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788725753.251299:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788725753.251300:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725753.251301:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725753.251302:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725753.251303:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725753.251304:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725753.251305:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725753.251306:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725753.251307:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725753.251308:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788725753.251327:0:7440:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788725753.251341:0:7440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791377152:0@lo:253: 00000100:00100000:1.0:1788725753.251398:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725753.251422:0:7440:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032bb8628 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.251537:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377152 00000100:00100000:2.0:1788725753.251553:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377152 00000100:00100000:2.0:1788725753.251594:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788725753.251602:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e27bda47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791377152:12345-0@lo:253: 20000000:01000000:2.0:1788725753.251622:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788725753.251634:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788725753.253295:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788725753.253389:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788725753.253408:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788725753.253636:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e27bda47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7440:x1875614791377152:12345-0@lo:253: Request processed in 2031us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.253647:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725753.253850:0:7440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7440:1875614791377152:0@lo:253: 10000000:01000000:1.0:1788725753.253862:0:7440:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788725753.253866:0:7440:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788725753.253868:0:7440:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788725753.253869:0:7440:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725753.253870:0:7440:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725753.253871:0:7440:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725753.253873:0:7440:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725753.253874:0:7440:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788725753.253876:0:7440:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725753.253877:0:7440:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725753.253878:0:7440:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725753.253879:0:7440:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788725753.253891:0:7440:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788725753.254453:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788725753.254459:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788725753.254478:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254504:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254512:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254519:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254621:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254637:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 14 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725753.254649:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791377280:0@lo:104: 00000100:00100000:3.0:1788725753.254693:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725753.254744:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254752:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725753.254758:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044bbdb3a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791377408:0@lo:104: 00000100:00100000:3.0:1788725753.254779:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725753.254795:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a7e4f53 going to sleep for 11 seconds 00000100:00100000:3.0:1788725753.254821:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377280 00000100:00100000:3.0:1788725753.254826:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377280 00000100:00100000:3.0:1788725753.254852:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377408 00000100:00100000:3.0:1788725753.254861:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377408 00000100:00100000:3.0:1788725753.254879:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725753.254886:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f28b1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791377280:12345-0@lo:104: 00010000:00010000:3.0:1788725753.254895:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.254945:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725753.254950:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f28b1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791377280:12345-0@lo:104: Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725753.254957:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725753.254972:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788725753.254977:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006333e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791377408:12345-0@lo:104: 00010000:00010000:3.0:1788725753.254984:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255014:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725753.255018:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006333e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791377408:12345-0@lo:104: Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725753.255023:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788725753.255040:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725753.255045:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255052:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008c7460f3 already unused, calling callback (00000000f98095d5) 10000000:00010000:3.0:1788725753.255054:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255061:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725753.255076:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725753.255080:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725753.255104:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255110:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725753.255147:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255154:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ac7 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255168:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725753.255170:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255175:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003dce583a already unused, calling callback (00000000f98095d5) 10000000:00010000:3.0:1788725753.255177:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255182:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725753.255186:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725753.255191:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725753.255208:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255214:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725753.255225:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255231:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000003dce583a/0xa13c582691d36a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725753.255243:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725753.255245:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725753.255246:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725753.255251:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725753.255257:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725753.256206:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791377280:0@lo:104: 00000100:00100000:2.0:1788725753.256218:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044bbdb3a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791377408:0@lo:104: 00010000:00010000:2.0:1788725753.256245:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725753.256335:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b546ae26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791377536:0@lo:103: 00000100:00100000:3.0:1788725753.256374:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.257195:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377536 00000100:00100000:2.0:1788725753.257203:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377536 00010000:00010000:2.0:1788725753.257230:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 15 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725753.257266:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725753.257274:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c1653ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3640:x1875614791377536:12345-0@lo:103: 00010000:00010000:2.0:1788725753.257285:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725753.257290:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 15 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.257300:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 15 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.257313:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000826ec554/0xa13c582691d36ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36ac0 expref: 15 pid: 6504 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.257326:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725753.257367:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c1653ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:3640:x1875614791377536:12345-0@lo:103: Request processed in 95us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.257374:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725753.257647:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b546ae26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791377536:0@lo:103: 00000100:00100000:0.0:1788725753.265521:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a2800c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791377664:0@lo:103: 00000100:00100000:0.0:1788725753.265608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1788725753.268384:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788725753.268569:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788725753.271111:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788725753.271440:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788725753.271800:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788725753.271959:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788725753.275952:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788725753.276181:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788725753.276362:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00000100:00100000:2.0:1788725753.276378:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377664 00000100:00100000:2.0:1788725753.276388:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377664 00010000:00010000:2.0:1788725753.276424:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725753.276465:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788725753.276481:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d110e131 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:3638:x1875614791377664:12345-0@lo:103: 00010000:00010000:2.0:1788725753.276496:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725753.276502:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276515:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276532:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b870b101/0xa13c582691d36a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36a18 expref: 14 pid: 6506 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788725753.276542:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00010000:00010000:2.0:1788725753.276548:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276557:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788725753.276574:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022115605s 00010000:00010000:2.0:1788725753.276577:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276584:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276590:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276596:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276602:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cbcea3e already unused, calling callback (00000000f88379cb) 00010000:00010000:2.0:1788725753.276611:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276619:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276644:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725753.276656:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725753.276746:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d110e131 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:3638:x1875614791377664:12345-0@lo:103: Request processed in 253us (11123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.276754:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:1.0:1788725753.276758:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00000100:00100000:2.0:1788725753.276846:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a2800c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791377664:0@lo:103: 00010000:00010000:0.0:1788725753.276865:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.276876:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725753.276882:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006cbcea3e/0xa13c582691d36aff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788725753.276976:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788725753.286288:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788725753.286664:0:7465:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788725753.286669:0:7465:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788725753.288725:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788725753.288799:0:7466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b546ae26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875614791377792:0@lo:700: 00000100:00100000:3.0:1788725753.288864:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725753.288922:0:7466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d96d52dd going to sleep for 11 seconds 00000040:01000000:2.0:1788725753.288994:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788725753.289480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377792 00000100:00100000:1.0:1788725753.289488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377792 00000100:00100000:1.0:1788725753.289537:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725753.289658:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c0e74a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875614791377792:12345-0@lo:700: 00000100:00100000:2.0:1788725753.291112:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791377920:0@lo:1000: 00000100:00100000:2.0:1788725753.291202:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.291240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791377920 00000100:00100000:2.0:1788725753.291246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791377920 00000100:00100000:2.0:1788725753.291299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725753.291307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bee40c71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791377920:12345-0@lo:1000: 00000100:00100000:2.0:1788725753.291375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bee40c71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791377920:12345-0@lo:1000: Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.291382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725753.291413:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.291447:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791377920:0@lo:1000: 00000040:01000000:2.0:1788725753.291475:0:7467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788725753.291503:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378048:0@lo:700: 00000100:00100000:2.0:1788725753.291528:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.291566:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378048 00000100:00100000:2.0:1788725753.291571:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378048 00000100:00100000:2.0:1788725753.291592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725753.291599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da638e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378048:12345-0@lo:700: 00000100:00100000:2.0:1788725753.291633:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da638e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378048:12345-0@lo:700: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.291640:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788725753.291654:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f725d75 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.291666:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378048:0@lo:700: 00000100:00100000:2.0:1788725753.291699:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1875614791378176:0@lo:900: 00000100:00100000:2.0:1788725753.291725:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.291749:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f725d75 going to sleep for 11 seconds 00000100:00100000:3.0:1788725753.292026:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378176 00000100:00100000:3.0:1788725753.292031:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378176 00000100:00100000:3.0:1788725753.292068:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788725753.292075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebf1d9d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1875614791378176:12345-0@lo:900: 00000100:00100000:3.0:1788725753.292129:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebf1d9d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7467:x1875614791378176:12345-0@lo:900: Request processed in 41us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725753.292143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1788725753.292721:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788725753.292842:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788725753.295845:0:7440:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788725753.295869:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788725753.296177:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:2.0:1788725753.297215:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e8218f6e x1875614791378176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788725769 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725753.297236:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7467:1875614791378176:0@lo:900: 00000100:00100000:2.0:1788725753.297371:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378304:0@lo:1000: 00000100:00100000:2.0:1788725753.297431:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.297471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378304 00000100:00100000:2.0:1788725753.297477:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378304 00000100:00100000:2.0:1788725753.297520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725753.297528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099e6b6fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378304:12345-0@lo:1000: 00000100:00100000:2.0:1788725753.297610:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099e6b6fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378304:12345-0@lo:1000: Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725753.297618:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725753.297667:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8f508d6 going to sleep for 11 seconds 00000100:00100000:2.0:1788725753.297684:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378304:0@lo:1000: 00000004:00080000:2.0:1788725753.297721:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009f725d75 with version 0 00000020:00100000:2.0:1788725753.297744:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788725753.297749:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8218f6e x1875614791378560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725753.297761:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378560:0@lo:1000: 00000100:00100000:2.0:1788725753.297784:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.297802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378560 00000100:00100000:2.0:1788725753.297806:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378560 00000100:00100000:2.0:1788725753.297821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788725753.297826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bf01aa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378560:12345-0@lo:1000: 00000100:00100000:2.0:1788725753.298110:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 000000009496c47d going to sleep for 11 seconds 00000040:00080000:3.0:1788725753.300724:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788725753.304283:0:7440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788725753.304353:0:7440:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788725753.305040:0:7440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788725753.307224:0:7440:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 40000000:02000000:1.0:1788725753.308129:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1788725753.310718:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788725753.310979:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000001:00080000:2.0:1788725753.312182:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788725753.312326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bf01aa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378560:12345-0@lo:1000: Request processed in 14495us (14537us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788725753.312344:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788725753.312368:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788725753.312372:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788725753.312387:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378560:0@lo:1000: 00000100:00100000:2.0:1788725753.312477:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378688:0@lo:1000: 00000100:00100000:2.0:1788725753.312513:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725753.312561:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788725753.313674:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378688 00000100:00100000:0.0:1788725753.313685:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378688 00000100:00100000:0.0:1788725753.313745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725753.313754:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d603fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378688:12345-0@lo:1000: 00000100:00100000:0.0:1788725753.313842:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d603fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1875614791378688:12345-0@lo:1000: Request processed in 90us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725753.313849:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:3.0:1788725753.313945:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:2.0:1788725753.314534:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7467:1875614791378688:0@lo:1000: 00000040:00080000:2.0:1788725753.314561:0:7467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788725753.314595:0:7467:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000009f725d75 with version 1 00000004:00080000:0.0:1788725753.314923:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bbfa2e91 version 1 rpc_version 1 00000020:00100000:0.0:1788725753.314945:0:7456:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788725753.314952:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c4691c43 x1875614791378944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725753.314970:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4691c43 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875614791378944:0@lo:1000: 00000100:00100000:0.0:1788725753.315036:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725753.315067:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791378944 00000100:00100000:0.0:1788725753.315071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791378944 00000100:00100000:0.0:1788725753.315099:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725753.315105:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a836ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1875614791378944:12345-0@lo:1000: 00000100:00100000:0.0:1788725753.315236:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d120593e going to sleep for 11 seconds 00100000:10000000:3.0:1788725753.316909:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000040:00080000:2.0:1788725753.319374:0:7467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788725753.319472:0:7467:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1788725753.320680:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788725753.320957:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788725753.321099:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788725753.321253:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788725753.321406:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788725753.321544:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788725753.321688:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788725753.321841:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788725753.321986:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788725753.322164:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788725753.322300:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788725753.322446:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788725753.322770:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788725753.322910:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788725753.323064:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788725753.323305:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788725753.323448:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788725753.323632:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:1.0:1788725753.328564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c0e74a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7466:x1875614791377792:12345-0@lo:700: Request processed in 38901us (39692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725753.328579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788725753.329208:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b546ae26 x1875614791377792/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788725769 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725753.329225:0:7466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b546ae26 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875614791377792:0@lo:700: 40000000:02000000:3.0:1788725753.329238:0:7466:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1788725753.330822:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788725753.331157:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788725753.331296:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788725753.331448:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788725753.331599:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788725753.331779:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788725753.331936:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788725753.332087:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788725753.332264:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788725753.332413:0:7440:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788725753.332611:0:7440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788725753.353084:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788725753.353292:0:7440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788725753.353324:0:7440:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaf8241c47988 00100000:10000000:2.0:1788725753.353333:0:7440:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1788725753.353348:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a836ce9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1875614791378944:12345-0@lo:1000: Request processed in 38239us (38309us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788725753.353361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:2.0:1788725753.355214:0:7440:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788725753.355255:0:7440:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788725753.355275:0:7440:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788725753.355290:0:7440:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000004:00080000:3.0:1788725753.355406:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788725753.355412:0:7456:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788725753.355429:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4691c43 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875614791378944:0@lo:1000: 00000020:00000004:2.0:1788725753.355971:0:7440:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725753.356171:0:7440:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788725753.391370:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725753.412330:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788725753.412405:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788725753.412410:0:7466:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788725753.723229:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725754.750840:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725755.784254:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725756.795225:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725757.819620:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725758.589257:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791379328:0@lo:400: 00000100:00100000:0.0:1788725758.589326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725758.589386:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725758.589392:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791379200:0@lo:400: 00000100:00100000:0.0:1788725758.590823:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725758.590887:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379328 00000100:00100000:0.0:1788725758.590895:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379328 00000100:00100000:0.0:1788725758.590945:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788725758.590956:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000751dd5a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791379328:12345-0@lo:400: 00000100:00100000:0.0:1788725758.591020:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000751dd5a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791379328:12345-0@lo:400: Request processed in 66us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725758.591027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788725758.591067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379200 00000100:00100000:0.0:1788725758.591071:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379200 00000100:00100000:0.0:1788725758.591114:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725758.591142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea53aa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791379200:12345-0@lo:400: 00000100:00100000:0.0:1788725758.591178:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea53aa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791379200:12345-0@lo:400: Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725758.591184:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788725758.591225:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d4ba0757 x1875614791379200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725758.591239:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791379200:0@lo:400: 00000100:00100000:0.0:1788725758.591250:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791379328:0@lo:400: 00000100:00100000:3.0:1788725758.591760:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791379456:0@lo:400: 00000100:00100000:3.0:1788725758.591806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725758.591861:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725758.591870:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eefa438a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791379072:0@lo:400: 00000100:00100000:3.0:1788725758.591900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725758.591941:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379072 00000100:00100000:3.0:1788725758.591946:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379072 00000100:00100000:3.0:1788725758.591979:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725758.591987:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004559042d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:3638:x1875614791379072:12345-0@lo:400: 00000100:00100000:3.0:1788725758.592026:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004559042d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:3638:x1875614791379072:12345-0@lo:400: Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725758.592032:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725758.592073:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eefa438a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791379072:0@lo:400: 00000100:00100000:0.0:1788725758.592710:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379456 00000100:00100000:0.0:1788725758.592718:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379456 00000100:00100000:0.0:1788725758.592748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725758.592754:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b546ae26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791379456:12345-0@lo:400: 00000100:00100000:0.0:1788725758.592799:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b546ae26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791379456:12345-0@lo:400: Request processed in 45us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725758.592806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788725758.593546:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002c61b5c2 x1875614791379456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725758.593560:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791379456:0@lo:400: 00000100:00100000:3.0:1788725758.593578:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725758.593585:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791379584:0@lo:41: 00000100:00100000:3.0:1788725758.593622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725758.593936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379584 00000100:00100000:2.0:1788725758.593942:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379584 00000100:00100000:2.0:1788725758.593984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725758.593994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e98969b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791379584:12345-0@lo:41: 00000004:00000024:2.0:1788725758.594025:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788725758.596520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e98969b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791379584:12345-0@lo:41: Request processed in 2519us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725758.596533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788725758.596981:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8218f6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791379584:0@lo:41: 00010000:00010000:0.0:1788725758.853534:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788725758.864516:0:7711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788725759.870458:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788725759.922532:0:7763:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788725759.922861:0:7763:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788725760.893680:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725761.916325:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788725762.172197:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788725762.172220:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b13bd660800 from 4 10000000:01000000:3.0:1788725762.172228:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725762.172297:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.172325:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.172339:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725762.172368:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000363c8262 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379712:0@lo:101: 00000100:00100000:3.0:1788725762.172461:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.172671:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cb41100 going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.172922:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379712 00000100:00100000:0.0:1788725762.172933:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379712 00000100:00100000:0.0:1788725762.173000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788725762.173011:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8666d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:6509:x1875614791379712:12345-0@lo:101: 00010000:00010000:0.0:1788725762.173033:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725762.173048:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad69dd69/0xa13c582691d36b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b06 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.173088:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad69dd69/0xa13c582691d36b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b06 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.173099:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad69dd69/0xa13c582691d36b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b06 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.173110:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad69dd69, rc 0) 00000100:00100000:0.0:1788725762.173214:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8666d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:6509:x1875614791379712:12345-0@lo:101: Request processed in 204us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.173221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788725762.175282:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000363c8262 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379712:0@lo:101: 00010000:00010000:1.0:1788725762.175318:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725762.175332:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725762.175420:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379840:0@lo:256: 00000100:00100000:1.0:1788725762.175510:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725762.175906:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052895e2d going to sleep for 11 seconds 00000100:00100000:1.0:1788725762.175936:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379840 00000100:00100000:1.0:1788725762.175945:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379840 00000100:00100000:1.0:1788725762.175998:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788725762.176008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d92bcd0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:6509:x1875614791379840:12345-0@lo:256: 20000000:01000000:1.0:1788725762.176033:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788725762.176053:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788725762.176057:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788725762.176181:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d92bcd0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:6509:x1875614791379840:12345-0@lo:256: Request processed in 173us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725762.176189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788725762.176254:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379840:0@lo:256: 10000000:01000000:1.0:1788725762.178010:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788725762.178021:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725762.178033:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000db0effa3/0xa13c582691d36b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725762.178044:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788725762.178047:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139116a000 from 21 10000000:01000000:1.0:1788725762.178050:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725762.178095:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725762.178103:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725762.178112:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725762.178163:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379968:0@lo:101: 00000100:00100000:1.0:1788725762.178375:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725762.178426:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052895e2d going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.179333:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791379968 00000100:00100000:3.0:1788725762.179347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791379968 00000100:00100000:3.0:1788725762.179414:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788725762.179424:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f42ecce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:6509:x1875614791379968:12345-0@lo:101: 00010000:00010000:3.0:1788725762.179443:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725762.179460:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006cbcea3e/0xa13c582691d36b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b14 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.179490:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cbcea3e/0xa13c582691d36b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b14 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.179501:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006cbcea3e/0xa13c582691d36b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b14 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.179511:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006cbcea3e, rc 0) 00000100:00100000:3.0:1788725762.179591:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f42ecce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791379968:12345-0@lo:101: Request processed in 169us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.179598:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788725762.182060:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791379968:0@lo:101: 00010000:00010000:1.0:1788725762.182097:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725762.182110:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725762.182278:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380096:0@lo:501: 00000100:00100000:1.0:1788725762.182350:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725762.182395:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052895e2d going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.182810:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380096 00000100:00100000:0.0:1788725762.182820:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380096 00000100:00100000:0.0:1788725762.182876:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788725762.182886:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054ef8c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791380096:12345-0@lo:501: 00000100:00100000:0.0:1788725762.183067:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054ef8c06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791380096:12345-0@lo:501: Request processed in 182us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.183076:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788725762.183511:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380096:0@lo:501: 00000100:00100000:2.0:1788725762.183585:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c87eb34e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380224:0@lo:503: 00000100:00100000:2.0:1788725762.183646:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725762.183694:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003bf99db going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.189000:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380224 00000100:00100000:0.0:1788725762.189025:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380224 00000100:00100000:0.0:1788725762.189261:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788725762.189275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f98a243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791380224:12345-0@lo:503: 00000100:00100000:0.0:1788725762.189516:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f98a243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791380224:12345-0@lo:503: Request processed in 244us (5870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.189524:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788725762.190320:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c87eb34e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380224:0@lo:503: 00000100:00100000:0.0:1788725762.202382:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7825:1875614791380352:0@lo:502: 00000100:00100000:0.0:1788725762.202535:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.202598:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd6e3648 going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.206058:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380352 00000100:00100000:3.0:1788725762.206082:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380352 00000100:00100000:3.0:1788725762.206182:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788725762.206194:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd407e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7825:x1875614791380352:12345-0@lo:502: 00000100:00100000:3.0:1788725762.206440:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd407e5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7825:x1875614791380352:12345-0@lo:502: Request processed in 249us (3905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.206451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788725762.206699:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7825:1875614791380352:0@lo:502: 00000100:00100000:0.0:1788725762.206784:0:7825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7825:1875614791380480:0@lo:502: 00000100:00100000:0.0:1788725762.206835:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.206883:0:7825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd6e3648 going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.206991:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380480 00000100:00100000:3.0:1788725762.206997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380480 00000100:00100000:3.0:1788725762.207037:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788725762.207046:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075043009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7825:x1875614791380480:12345-0@lo:502: 00000100:00100000:3.0:1788725762.207196:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075043009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:7825:x1875614791380480:12345-0@lo:502: Request processed in 151us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.207204:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788725762.213776:0:7825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7825:1875614791380480:0@lo:502: 00000040:00080000:0.0:1788725762.213843:0:7825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788725762.214238:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788725762.214273:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725762.214286:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.214299:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000008c7460f3/0xa13c582691d36b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725762.214310:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788725762.214364:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139116a000 from 4 10000000:01000000:3.0:1788725762.214368:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725762.214418:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.215259:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.215293:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725762.215376:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380608:0@lo:101: 00000100:00100000:3.0:1788725762.215467:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.215543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380608 00000100:00100000:3.0:1788725762.215544:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.215555:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380608 00000100:00100000:0.0:1788725762.215626:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788725762.215637:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d08f5466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791380608:12345-0@lo:101: 00010000:00010000:0.0:1788725762.215729:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725762.215748:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009415f912/0xa13c582691d36b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b22 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.215779:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009415f912/0xa13c582691d36b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.215791:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009415f912/0xa13c582691d36b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.215802:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009415f912, rc 0) 00000100:00100000:0.0:1788725762.215853:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d08f5466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791380608:12345-0@lo:101: Request processed in 217us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.215860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788725762.216272:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380608:0@lo:101: 00010000:00010000:3.0:1788725762.216292:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.216302:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725762.217322:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380736:0@lo:256: 00000100:00100000:3.0:1788725762.217402:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.217442:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.217468:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380736 00000100:00100000:3.0:1788725762.217474:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380736 00000100:00100000:3.0:1788725762.217517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788725762.217526:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007508a9a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791380736:12345-0@lo:256: 20000000:01000000:3.0:1788725762.217548:0:6506:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788725762.217564:0:6506:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788725762.217567:0:6506:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788725762.218812:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007508a9a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791380736:12345-0@lo:256: Request processed in 1279us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.218828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788725762.218905:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380736:0@lo:256: 10000000:01000000:3.0:1788725762.218964:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788725762.218974:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.218985:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 00000000e57d39eb/0xa13c582691d36b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725762.218995:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788725762.218998:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788725762.219001:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788725762.219035:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.219043:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.219051:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725762.219067:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380864:0@lo:101: 00000100:00100000:3.0:1788725762.219095:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.219147:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.220227:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380864 00000100:00100000:0.0:1788725762.220244:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380864 00000100:00100000:0.0:1788725762.220323:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788725762.220347:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ad37c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791380864:12345-0@lo:101: 00010000:00010000:0.0:1788725762.220367:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725762.220385:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003dce583a/0xa13c582691d36b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b30 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.220415:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003dce583a/0xa13c582691d36b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b30 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.220443:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003dce583a/0xa13c582691d36b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b30 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725762.220453:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003dce583a, rc 0) 00000100:00100000:0.0:1788725762.220524:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ad37c4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791380864:12345-0@lo:101: Request processed in 180us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.220531:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788725762.221302:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380864:0@lo:101: 00010000:00010000:3.0:1788725762.221328:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725762.221342:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725762.221459:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380992:0@lo:501: 00000100:00100000:3.0:1788725762.221510:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.221551:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791380992 00000100:00100000:3.0:1788725762.221557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791380992 00000100:00100000:3.0:1788725762.221596:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788725762.221606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008da390b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791380992:12345-0@lo:501: 00000100:00100000:3.0:1788725762.222394:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008da390b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791380992:12345-0@lo:501: Request processed in 786us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.222405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788725762.222461:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.222483:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791380992:0@lo:501: 00000100:00100000:3.0:1788725762.222542:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791381120:0@lo:503: 00000100:00100000:3.0:1788725762.222592:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.222624:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000911056c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.222744:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381120 00000100:00100000:0.0:1788725762.222751:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381120 00000100:00100000:0.0:1788725762.222794:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788725762.222804:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000552b8271 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791381120:12345-0@lo:503: 00000100:00100000:0.0:1788725762.222913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000552b8271 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791381120:12345-0@lo:503: Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.222922:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788725762.223768:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791381120:0@lo:503: 00000100:00100000:3.0:1788725762.224392:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7827:1875614791381248:0@lo:502: 00000100:00100000:3.0:1788725762.224470:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.224514:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078a6f529 going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.228298:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381248 00000100:00100000:3.0:1788725762.228334:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381248 00000100:00100000:3.0:1788725762.228410:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788725762.228422:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068ad7d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:7827:x1875614791381248:12345-0@lo:502: 00000100:00100000:3.0:1788725762.228663:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068ad7d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:7827:x1875614791381248:12345-0@lo:502: Request processed in 243us (4194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.228691:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788725762.228775:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7827:1875614791381248:0@lo:502: 00000020:01000000:3.0:1788725762.228823:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725762.228839:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725762.228842:0:7827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788725762.228846:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788725762.228850:0:7827:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:3.0:1788725762.228882:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788725762.228905:0:7827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000781ac46d) 00000020:00000080:3.0:1788725762.228933:0:7827:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788725762.228939:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788725762.229053:0:7827:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788725762.229061:0:7827:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788725762.229070:0:7827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d36b45 00010000:00080000:3.0:1788725762.229112:0:7827:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b7130aa2@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788725762.233411:0:7827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788725762.235249:0:7827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788725762.235270:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788725762.235320:0:7827:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788725762.235348:0:7827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36b4c 00000100:00080000:3.0:1788725762.235361:0:7827:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725762.235367:0:7827:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000b7130aa2 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725762.235415:0:7827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000beb97bb2 x1875614791381376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788725762.236464:0:7827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788725762.236511:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791381376:0@lo:38: 00000040:01000000:3.0:1788725762.236542:0:7827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788725762.236693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725762.236906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381376 00000100:00100000:2.0:1788725762.236915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381376 00000100:00100000:2.0:1788725762.236998:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725762.237007:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000489ea725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791381376:12345-0@lo:38: 00010000:00080000:2.0:1788725762.237045:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1788725762.237090:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36b53 00000004:00100000:2.0:1788725762.237112:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788725762.237138:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788725762.237171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791381632:0@lo:400: 00000100:00100000:0.0:1788725762.237217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.237979:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788725762.238133:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788725762.238181:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725762.238193:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791381504:0@lo:400: 00000100:00100000:0.0:1788725762.238244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.238279:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725762.239513:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381632 00000100:00100000:3.0:1788725762.239527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381632 00000100:00100000:3.0:1788725762.239714:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725762.239726:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eefa438a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791381632:12345-0@lo:400: 00000100:00100000:3.0:1788725762.239837:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eefa438a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791381632:12345-0@lo:400: Request processed in 113us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.239846:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725762.240282:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791381760:0@lo:400: 00000100:00100000:0.0:1788725762.240380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.240468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381504 00000100:00100000:0.0:1788725762.240477:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381504 00000100:00100000:0.0:1788725762.240559:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381760 00000100:00100000:0.0:1788725762.240563:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381760 00000100:00100000:0.0:1788725762.240584:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725762.240593:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4691c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791381504:12345-0@lo:400: 00000100:00100000:0.0:1788725762.240661:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4691c43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791381504:12345-0@lo:400: Request processed in 69us (2417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.240669:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725762.240705:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788725762.240712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cb076af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791381760:12345-0@lo:400: 00000100:00100000:0.0:1788725762.240746:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cb076af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791381760:12345-0@lo:400: Request processed in 36us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.240752:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788725762.240796:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000349f843a x1875614791381504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725762.240812:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000349f843a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791381504:0@lo:400: 00000100:00100000:0.0:1788725762.240825:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791381632:0@lo:400: 00010000:00080000:0.0:1788725762.240888:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002c61b5c2 x1875614791381760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725762.240900:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791381760:0@lo:400: 00000100:00080000:0.0:1788725762.243613:0:7831:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000002c61b5c2 x1875614791381888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725762.243627:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fc1e52f going to sleep for 0 seconds 00000020:01000000:3.0:1788725762.243815:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725762.243823:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725762.243826:0:7827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788725762.243829:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725762.243833:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725762.243835:0:7827:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788725762.243840:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788725762.243841:0:7827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788725762.243868:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9540ed0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7827:1875614791382016:0@lo:502: 00000100:00100000:3.0:1788725762.243946:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.244005:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090ec34b3 going to sleep for 11 seconds 00000100:00100000:0.0:1788725762.244372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382016 00000100:00100000:0.0:1788725762.244381:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382016 00000100:00100000:0.0:1788725762.244473:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788725762.244484:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cb7ceca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:7827:x1875614791382016:12345-0@lo:502: 00000100:00100000:0.0:1788725762.244626:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cb7ceca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:7827:x1875614791382016:12345-0@lo:502: Request processed in 144us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725762.244634:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788725762.257069:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9540ed0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:7827:1875614791382016:0@lo:502: 00000020:01000000:2.0:1788725762.257134:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725762.257142:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725762.257144:0:7827:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788725762.257149:0:7827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788725762.257282:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788725762.257302:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788725762.257311:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257320:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 000000001deea6e1/0xa13c582691d36b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725762.257329:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788725762.257332:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b13a96d0000 from 1 10000000:01000000:2.0:1788725762.257335:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725762.257365:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257382:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257392:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725762.257411:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791382144:0@lo:101: 00000100:00100000:2.0:1788725762.257473:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725762.257513:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003bf99db going to sleep for 11 seconds 00000100:00100000:2.0:1788725762.257532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382144 00000100:00100000:2.0:1788725762.257538:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382144 00000100:00100000:2.0:1788725762.257584:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788725762.257595:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc430651 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791382144:12345-0@lo:101: 00010000:00010000:2.0:1788725762.257608:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725762.257619:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006e34383e/0xa13c582691d36b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b5a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257643:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e34383e/0xa13c582691d36b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257652:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006e34383e/0xa13c582691d36b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.257660:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006e34383e, rc 0) 00000100:00100000:2.0:1788725762.258259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc430651 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791382144:12345-0@lo:101: Request processed in 666us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725762.258267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788725762.258312:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791382144:0@lo:101: 00010000:00010000:2.0:1788725762.258332:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.258341:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725762.258397:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791382272:0@lo:501: 00000100:00100000:2.0:1788725762.258426:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725762.258450:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003bf99db going to sleep for 11 seconds 00000100:00100000:2.0:1788725762.258463:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382272 00000100:00100000:2.0:1788725762.258467:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382272 00000100:00100000:2.0:1788725762.258493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788725762.258499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a76055c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791382272:12345-0@lo:501: 00000100:00100000:2.0:1788725762.258572:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a76055c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791382272:12345-0@lo:501: Request processed in 73us (146us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725762.258580:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788725762.258609:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791382272:0@lo:501: 10000000:01000000:2.0:1788725762.258630:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788725762.258635:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725762.258642:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: 0000000086bdd0de/0xa13c582691d36b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788725762.268753:0:6515:0:(import.c:65:import_set_state_nolock()) 00000000cf1accfd : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725762.268852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000489ea725 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791381376:12345-0@lo:38: Request processed in 31844us (32158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725762.268873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725762.269438:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788725762.269451:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788725762.269461:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788725762.269467:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788725762.269469:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000b7130aa2 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788725762.269491:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000fc1e52f): req@000000002c61b5c2 x1875614791381888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725762.269508:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791381376:0@lo:38: 00000100:00100000:0.0:1788725762.269759:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791382400:0@lo:41: 00000100:00100000:0.0:1788725762.269812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.269898:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.269914:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fc1e52f going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.270658:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382400 00000100:00100000:3.0:1788725762.270667:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382400 00000100:00100000:3.0:1788725762.270718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791381888 00000100:00100000:3.0:1788725762.270727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791381888 00000100:00100000:3.0:1788725762.270749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725762.270757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000349f843a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791382400:12345-0@lo:41: 00000004:00000024:3.0:1788725762.270788:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788725762.270863:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000349f843a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791382400:12345-0@lo:41: Request processed in 104us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.270876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788725762.270905:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725762.270916:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035f39293 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791381888:12345-0@lo:1000: 00000100:00100000:3.0:1788725762.271005:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035f39293 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791381888:12345-0@lo:1000: Request processed in 93us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.271013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725762.271221:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4ba0757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791382400:0@lo:41: 00000100:00100000:0.0:1788725762.274047:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791381888:0@lo:1000: 00000040:01000000:0.0:1788725762.274094:0:7831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788725762.274162:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382528:0@lo:1000: 00000100:00100000:0.0:1788725762.274232:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.274262:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 000000000fc1e52f going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.275669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382528 00000100:00100000:3.0:1788725762.275695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382528 00000100:00100000:3.0:1788725762.275741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788725762.275749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f4019f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382528:12345-0@lo:1000: 00000100:00100000:3.0:1788725762.275893:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f4019f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382528:12345-0@lo:1000: Request processed in 143us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.275900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725762.275984:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382528:0@lo:1000: 00000100:00100000:0.0:1788725762.276103:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382656:0@lo:700: 00000100:00100000:0.0:1788725762.276735:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725762.276777:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a7537f3 going to sleep for 11 seconds 00000100:00100000:1.0:1788725762.276894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382656 00000100:00100000:1.0:1788725762.276911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382656 00000100:00100000:1.0:1788725762.277196:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725762.277209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008036b7d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382656:12345-0@lo:700: 00000100:00100000:1.0:1788725762.277327:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008036b7d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382656:12345-0@lo:700: Request processed in 120us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725762.277337:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725762.284219:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c61b5c2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382656:0@lo:700: 00000100:00100000:3.0:1788725762.284383:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382784:0@lo:1000: 00000100:00100000:3.0:1788725762.284447:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.284476:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e81fbd going to sleep for 11 seconds 00000100:00100000:3.0:1788725762.284498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791382784 00000100:00100000:3.0:1788725762.284504:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791382784 00000100:00100000:3.0:1788725762.285106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725762.285146:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9540ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382784:12345-0@lo:1000: 00000100:00100000:3.0:1788725762.285388:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9540ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791382784:12345-0@lo:1000: Request processed in 273us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725762.285396:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725762.285518:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791382784:0@lo:1000: 00000004:00080000:3.0:1788725762.286182:0:7831:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000047191651 with version 0 00000020:00100000:3.0:1788725762.286715:0:7831:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788725762.286725:0:7831:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000beb97bb2 x1875614791383040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788725762.286747:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791383040:0@lo:1000: 00000100:00100000:3.0:1788725762.286795:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725762.286825:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b891687 going to sleep for 11 seconds 00000100:00100000:2.0:1788725762.293176:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383040 00000100:00100000:2.0:1788725762.293194:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383040 00000100:00100000:2.0:1788725762.293264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788725762.293274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000363c8262 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7831:x1875614791383040:12345-0@lo:1000: 00000001:00080000:2.0:1788725762.300198:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788725762.300216:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788725762.300354:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000363c8262 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7831:x1875614791383040:12345-0@lo:1000: Request processed in 7078us (13555us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788725762.300367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788725762.302527:0:7831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788725762.302538:0:7831:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788725762.302556:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000beb97bb2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791383040:0@lo:1000: 00000100:00100000:2.0:1788725762.303338:0:7831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791383168:0@lo:1000: 00000100:00100000:2.0:1788725762.303396:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725762.303437:0:7831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000636feb97 going to sleep for 11 seconds 00000100:00100000:2.0:1788725762.304192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383168 00000100:00100000:2.0:1788725762.304202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383168 00000100:00100000:2.0:1788725762.304262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788725762.304273:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008871ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1875614791383168:12345-0@lo:1000: 00000100:00100000:2.0:1788725762.304361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008871ea6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7831:x1875614791383168:12345-0@lo:1000: Request processed in 89us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725762.304371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788725762.304404:0:7831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7831:1875614791383168:0@lo:1000: 00000040:00080000:2.0:1788725762.304425:0:7831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788725762.304461:0:7831:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000636feb97 with version 1 00000004:00080000:1.0:1788725762.304575:0:7829:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000835d78e7 version 1 rpc_version 1 00000020:00100000:1.0:1788725762.304627:0:7829:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788725762.304637:0:7829:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f2bd7276 x1875614791383424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725762.304685:0:7829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7829:1875614791383424:0@lo:1000: 00000100:00100000:1.0:1788725762.304752:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725762.304786:0:7829:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d80531b going to sleep for 11 seconds 00000100:00100000:1.0:1788725762.304815:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383424 00000100:00100000:1.0:1788725762.304821:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383424 00000100:00100000:1.0:1788725762.304863:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788725762.304871:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db48899e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1875614791383424:12345-0@lo:1000: 00000040:00080000:2.0:1788725762.308445:0:7831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788725762.308536:0:7831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788725762.308541:0:7831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788725762.309007:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788725762.309222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db48899e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1875614791383424:12345-0@lo:1000: Request processed in 4345us (4463us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788725762.309240:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788725762.309311:0:7829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788725762.309332:0:7829:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788725762.309355:0:7829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2bd7276 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7829:1875614791383424:0@lo:1000: 00010000:00010000:3.0:1788725762.947932:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725763.034955:0:7871:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725763.035389:0:7871:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788725763.708321:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791383552:0@lo:41: 00000100:00100000:3.0:1788725763.708391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725763.708492:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383552 00000100:00100000:2.0:1788725763.708501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383552 00000100:00100000:2.0:1788725763.708553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788725763.708562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a2800c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791383552:12345-0@lo:41: 00000004:00000024:2.0:1788725763.708594:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788725763.708639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a2800c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791383552:12345-0@lo:41: Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725763.708646:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788725763.708696:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005df149ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791383552:0@lo:41: 00010000:00010000:1.0:1788725763.968084:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788725763.993830:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4087d7a0 20000000:00000080:3.0:1788725763.993848:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b139e589c00 uarg=0000000000000000 20000000:01000000:3.0:1788725763.993898:0:7919:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788725763.993905:0:7919:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788725763.993910:0:7919:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788725763.993977:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788725763.993987:0:7919:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788725763.997783:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788725763.998038:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788725763.998070:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788725763.998088:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788725763.998104:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788725763.998369:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998389:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998396:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ace expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998401:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998441:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998454:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 17 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725763.998467:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e29a3f4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875614791383680:0@lo:104: 00000100:00100000:3.0:1788725763.998543:0:7919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725763.998599:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725763.998607:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725763.998614:0:7919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c1653ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875614791383808:0@lo:104: 00000100:00100000:3.0:1788725763.998634:0:7919:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc878614 going to sleep for 11 seconds 00000100:00100000:1.0:1788725763.998772:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788725763.998791:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725763.998837:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383680 00000100:00100000:1.0:1788725763.998846:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383680 00000100:00100000:1.0:1788725763.998881:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383808 00000100:00100000:1.0:1788725763.998884:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383808 00000100:00100000:1.0:1788725763.998898:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788725763.998904:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc1725aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:7919:x1875614791383680:12345-0@lo:104: 00010000:00010000:1.0:1788725763.998915:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.998979:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725763.998985:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc1725aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:7919:x1875614791383680:12345-0@lo:104: Request processed in 81us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725763.998992:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788725763.999028:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725763.999034:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2bd7276 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:7919:x1875614791383808:12345-0@lo:104: 00010000:00010000:1.0:1788725763.999042:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999073:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725763.999078:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2bd7276 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:7919:x1875614791383808:12345-0@lo:104: Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725763.999083:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788725763.999099:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788725763.999110:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999140:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d5db79e already unused, calling callback (00000000f98095d5) 10000000:00010000:1.0:1788725763.999143:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999150:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725763.999156:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725763.999161:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725763.999184:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999189:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725763.999270:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999276:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000000d5db79e/0xa13c582691d36ace lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ad5 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999287:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725763.999289:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999294:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007f32caf6 already unused, calling callback (00000000f98095d5) 10000000:00010000:1.0:1788725763.999295:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999310:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725763.999316:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725763.999321:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725763.999334:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999340:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725763.999353:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999359:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: 000000007f32caf6/0xa13c582691d369e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d369e7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725763.999370:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725763.999371:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725763.999373:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725763.999384:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791384064:0@lo:103: 00000100:00100000:2.0:1788725763.999776:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725763.999787:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0c54cf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791383936:0@lo:103: 00000100:00100000:2.0:1788725763.999846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725763.999911:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e29a3f4 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875614791383680:0@lo:104: 00000100:00100000:2.0:1788725763.999919:0:7919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c1653ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875614791383808:0@lo:104: 00010000:00010000:2.0:1788725763.999937:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725764.001840:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725764.001867:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791383936 00000100:00100000:0.0:1788725764.001896:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791383936 00010000:00010000:0.0:1788725764.001939:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 18 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725764.002022:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788725764.002031:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005df149ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3640:x1875614791383936:12345-0@lo:103: 00010000:00010000:0.0:1788725764.002054:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725764.002060:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 18 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725764.002071:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 18 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725764.002086:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000221613e7/0xa13c582691d36ad5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36ace expref: 18 pid: 6504 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725764.002101:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725764.002207:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005df149ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3640:x1875614791383936:12345-0@lo:103: Request processed in 177us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725764.002214:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788725764.002307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725764.002374:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0c54cf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791383936:0@lo:103: 00000100:00100000:2.0:1788725764.002725:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384064 00000100:00100000:2.0:1788725764.002731:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384064 00010000:00010000:2.0:1788725764.002751:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725764.002765:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788725764.002780:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce6c4f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3638:x1875614791384064:12345-0@lo:103: 00010000:00010000:2.0:1788725764.002788:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725764.002792:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002800:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002810:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b11ff559/0xa13c582691d369e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d369e0 expref: 17 pid: 6506 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002820:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002827:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002840:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002846:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002851:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002857:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002864:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000312fae2c already unused, calling callback (00000000f88379cb) 00010000:00010000:2.0:1788725764.002867:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002880:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002900:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725764.002911:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725764.002944:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce6c4f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3638:x1875614791384064:12345-0@lo:103: Request processed in 166us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725764.002951:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725764.003009:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791384064:0@lo:103: 00010000:00010000:1.0:1788725764.003031:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725764.003038:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725764.003054:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000312fae2c/0xa13c582691d36b68 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725764.989404:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725766.011724:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725767.035528:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725767.293472:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725767.293495:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791384192:0@lo:41: 00000100:00100000:1.0:1788725767.293560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725767.295433:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044bbdb3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791384320:0@lo:400: 00000100:00100000:3.0:1788725767.295508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725767.295550:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791384832:0@lo:400: 00000100:00100000:3.0:1788725767.295578:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791384704:0@lo:400: 00000100:00100000:3.0:1788725767.295602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725767.295627:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725767.295632:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791384576:0@lo:400: 00000100:00100000:2.0:1788725767.295738:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384320 00000100:00100000:2.0:1788725767.295747:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384320 00000100:00100000:2.0:1788725767.295800:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788725767.295808:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006552a8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3640:x1875614791384320:12345-0@lo:400: 00000100:00100000:2.0:1788725767.295859:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006552a8d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3640:x1875614791384320:12345-0@lo:400: Request processed in 52us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725767.295866:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788725767.296378:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384704 00000100:00100000:2.0:1788725767.296384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384704 00000100:00100000:2.0:1788725767.296422:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725767.296429:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e29c36b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791384704:12345-0@lo:400: 00000100:00100000:2.0:1788725767.296467:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e29c36b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791384704:12345-0@lo:400: Request processed in 39us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725767.296473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788725767.296492:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791384448:0@lo:400: 00000100:00100000:2.0:1788725767.296517:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725767.296593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384448 00000100:00100000:3.0:1788725767.296598:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384448 00000100:00100000:3.0:1788725767.296628:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725767.296634:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018d16196 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791384448:12345-0@lo:400: 00000100:00100000:3.0:1788725767.296682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018d16196 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791384448:12345-0@lo:400: Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725767.296688:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788725767.296723:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000066c97504 x1875614791384448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725767.296736:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066c97504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791384448:0@lo:400: 00000100:00100000:3.0:1788725767.298527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788725767.298581:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a3282161 x1875614791384704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725767.298595:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3282161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791384704:0@lo:400: 00000100:00100000:1.0:1788725767.298738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384192 00000100:00100000:1.0:1788725767.298746:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384192 00000100:00100000:1.0:1788725767.298790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384576 00000100:00100000:1.0:1788725767.298793:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384576 00000100:00100000:1.0:1788725767.298807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725767.298814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aab8d635 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791384192:12345-0@lo:41: 00000004:00000024:1.0:1788725767.298851:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788725767.298910:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aab8d635 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791384192:12345-0@lo:41: Request processed in 97us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725767.298917:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725767.298930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725767.298936:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066c97504 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791384576:12345-0@lo:400: 00000100:00100000:1.0:1788725767.299054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066c97504 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791384576:12345-0@lo:400: Request processed in 119us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725767.299061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725767.299086:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e80b716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791384576:0@lo:400: 00000100:00100000:1.0:1788725767.299142:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791384192:0@lo:41: 00000100:00100000:2.0:1788725767.299240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725767.299279:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044bbdb3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791384320:0@lo:400: 00000100:00100000:3.0:1788725767.299402:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384832 00000100:00100000:3.0:1788725767.299407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384832 00000100:00100000:3.0:1788725767.299430:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725767.299435:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072171c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791384832:12345-0@lo:400: 00000100:00100000:3.0:1788725767.299474:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072171c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791384832:12345-0@lo:400: Request processed in 39us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725767.299490:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725767.299514:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b896204b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791384832:0@lo:400: 00010000:00010000:0.0:1788725768.063306:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725768.827331:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000518c89a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791384960:0@lo:41: 00000100:00100000:3.0:1788725768.827402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725768.827497:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791384960 00000100:00100000:2.0:1788725768.827506:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791384960 00000100:00100000:2.0:1788725768.827556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725768.827565:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b896204b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791384960:12345-0@lo:41: 00000004:00000024:2.0:1788725768.827596:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788725768.827648:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b896204b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791384960:12345-0@lo:41: Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725768.827654:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788725768.827727:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000518c89a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791384960:0@lo:41: 00010000:00010000:0.0:1788725769.085345:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725770.108541:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788725770.364857:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788725770.364869:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b13bd660800 from 1 10000000:01000000:0.0:1788725770.364876:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788725770.364942:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: 0000000045191a9c/0xa13c582691d36b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.364956:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: 0000000045191a9c/0xa13c582691d36b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.364968:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: 0000000045191a9c/0xa13c582691d36b6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725770.364997:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385088:0@lo:101: 00000100:00100000:0.0:1788725770.365190:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725770.365319:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5bb21eb going to sleep for 11 seconds 00000100:00100000:2.0:1788725770.365505:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385088 00000100:00100000:2.0:1788725770.365517:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385088 00000100:00100000:2.0:1788725770.365584:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788725770.365595:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004856fea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791385088:12345-0@lo:101: 00010000:00010000:2.0:1788725770.365612:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725770.365637:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b8c6893/0xa13c582691d36b76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b6f expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725770.365672:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b8c6893/0xa13c582691d36b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b6f expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725770.365683:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b8c6893/0xa13c582691d36b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b6f expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725770.365693:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b8c6893, rc 0) 00000100:00100000:2.0:1788725770.365742:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004856fea3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385088:12345-0@lo:101: Request processed in 148us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725770.365749:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788725770.365859:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385088:0@lo:101: 00010000:00010000:0.0:1788725770.365875:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: 0000000045191a9c/0xa13c582691d36b6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.365884:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: 0000000045191a9c/0xa13c582691d36b6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725770.365961:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385216:0@lo:501: 00000100:00100000:0.0:1788725770.365990:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725770.366083:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5bb21eb going to sleep for 11 seconds 00000100:00100000:2.0:1788725770.366410:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385216 00000100:00100000:2.0:1788725770.366429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385216 00000100:00100000:2.0:1788725770.366465:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788725770.366473:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1883195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385216:12345-0@lo:501: 00000100:00100000:2.0:1788725770.366636:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1883195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385216:12345-0@lo:501: Request processed in 164us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725770.366644:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788725770.366759:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385216:0@lo:501: 00000100:00100000:0.0:1788725770.366813:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385344:0@lo:503: 00000100:00100000:0.0:1788725770.366856:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725770.366879:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5bb21eb going to sleep for 11 seconds 00000100:00100000:2.0:1788725770.366929:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385344 00000100:00100000:2.0:1788725770.366933:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385344 00000100:00100000:2.0:1788725770.367225:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788725770.367236:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a21e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385344:12345-0@lo:503: 00000100:00100000:2.0:1788725770.367362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a21e1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385344:12345-0@lo:503: Request processed in 128us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725770.367370:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725770.367557:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000367b6156 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385344:0@lo:503: 00000100:00100000:1.0:1788725770.367839:0:8232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8232:1875614791385472:0@lo:502: 00000100:00100000:1.0:1788725770.367890:0:8232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725770.368726:0:8232:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae660173 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.368787:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385472 00000100:00100000:0.0:1788725770.368799:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385472 00000100:00100000:0.0:1788725770.368851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725770.368860:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001294553c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8232:x1875614791385472:12345-0@lo:502: 00000100:00100000:0.0:1788725770.369149:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001294553c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8232:x1875614791385472:12345-0@lo:502: Request processed in 288us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.369169:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788725770.369633:0:8232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f77c372f pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8232:1875614791385472:0@lo:502: 00000020:01000000:1.0:1788725770.369677:0:8232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725770.369692:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725770.369695:0:8232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788725770.369705:0:8232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b13bd660800 00000020:00000080:1.0:1788725770.369708:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725770.369787:0:8232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8232:1875614791385600:0@lo:502: 00000100:00100000:1.0:1788725770.369852:0:8232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725770.369892:0:8232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.373416:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385600 00000100:00100000:0.0:1788725770.373434:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385600 00000100:00100000:0.0:1788725770.373507:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725770.373518:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8232:x1875614791385600:12345-0@lo:502: 00000100:00100000:0.0:1788725770.373735:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8232:x1875614791385600:12345-0@lo:502: Request processed in 218us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.373745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725770.375422:0:8232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8232:1875614791385600:0@lo:502: 00000020:01000000:0.0:1788725770.375473:0:8232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725770.375483:0:8232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725770.375486:0:8232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788725770.375490:0:8232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788725770.377663:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788725770.377714:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725770.377728:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725770.377743:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725770.377756:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788725770.377759:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139116a000 from 1 10000000:01000000:1.0:1788725770.377762:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788725770.377812:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725770.377820:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725770.377852:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725770.377882:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385728:0@lo:101: 00000100:00100000:1.0:1788725770.377979:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725770.378763:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385728 00000100:00100000:0.0:1788725770.378776:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385728 00000100:00100000:0.0:1788725770.378843:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788725770.378854:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791385728:12345-0@lo:101: 00010000:00010000:0.0:1788725770.378873:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725770.378891:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36b7d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.378984:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36b7d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.378996:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b7d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725770.379005:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af400, rc 0) 00000100:00100000:1.0:1788725770.379133:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.380835:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791385728:12345-0@lo:101: Request processed in 1971us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.380849:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788725770.385343:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385728:0@lo:101: 00010000:00010000:2.0:1788725770.385384:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725770.385400:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725770.385518:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385856:0@lo:501: 00000100:00100000:2.0:1788725770.385600:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725770.387381:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.395141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385856 00000100:00100000:0.0:1788725770.395163:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385856 00000100:00100000:0.0:1788725770.395822:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725770.395836:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791385856:12345-0@lo:501: 00000100:00100000:0.0:1788725770.396474:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791385856:12345-0@lo:501: Request processed in 637us (10868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.396484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725770.396544:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385856:0@lo:501: 00000100:00100000:0.0:1788725770.396627:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385984:0@lo:503: 00000100:00100000:0.0:1788725770.396691:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725770.397363:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791385984 00000100:00100000:3.0:1788725770.397379:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791385984 00000100:00100000:3.0:1788725770.397444:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788725770.397459:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791385984:12345-0@lo:503: 00000100:00100000:3.0:1788725770.397661:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791385984:12345-0@lo:503: Request processed in 206us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725770.397668:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788725770.399346:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.399399:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791385984:0@lo:503: 00000100:00100000:3.0:1788725770.404589:0:8235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8235:1875614791386112:0@lo:502: 00000100:00100000:3.0:1788725770.404699:0:8235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725770.404747:0:8235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.404761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386112 00000100:00100000:0.0:1788725770.404777:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386112 00000100:00100000:0.0:1788725770.404843:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788725770.404856:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8235:x1875614791386112:12345-0@lo:502: 00000100:00100000:0.0:1788725770.405050:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8235:x1875614791386112:12345-0@lo:502: Request processed in 196us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.405058:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788725770.405306:0:8235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8235:1875614791386112:0@lo:502: 00000020:01000000:3.0:1788725770.405343:0:8235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725770.405353:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725770.405357:0:8235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788725770.405364:0:8235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139116a000 00000020:00000080:3.0:1788725770.405367:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788725770.405390:0:8235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8235:1875614791386240:0@lo:502: 00000100:00100000:3.0:1788725770.405436:0:8235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725770.405876:0:8235:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725770.406146:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386240 00000100:00100000:0.0:1788725770.406285:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386240 00000100:00100000:0.0:1788725770.406354:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788725770.406365:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8235:x1875614791386240:12345-0@lo:502: 00000100:00100000:0.0:1788725770.406504:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8235:x1875614791386240:12345-0@lo:502: Request processed in 141us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725770.406512:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788725770.407685:0:8235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8235:1875614791386240:0@lo:502: 00000020:01000000:3.0:1788725770.407745:0:8235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725770.407753:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725770.407756:0:8235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788725770.407762:0:8235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788725770.409428:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788725770.409474:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725770.409490:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725770.409505:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725771.132405:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725772.156103:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725772.412960:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725772.412990:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791386368:0@lo:41: 00000100:00100000:1.0:1788725772.413072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725772.413180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386368 00000100:00100000:1.0:1788725772.413188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386368 00000100:00100000:1.0:1788725772.413237:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788725772.413246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791386368:12345-0@lo:41: 00000004:00000024:1.0:1788725772.413635:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788725772.413693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791386368:12345-0@lo:41: Request processed in 448us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725772.413701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788725772.413797:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791386368:0@lo:41: 00000100:00100000:0.0:1788725772.414006:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791386624:0@lo:400: 00000100:00100000:0.0:1788725772.414036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725772.414057:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725772.414062:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791386752:0@lo:400: 00000100:00100000:0.0:1788725772.414082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725772.414107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386624 00000100:00100000:0.0:1788725772.414112:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386624 00000100:00100000:0.0:1788725772.414183:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725772.414191:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791386624:12345-0@lo:400: 00000100:00100000:0.0:1788725772.414229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791386624:12345-0@lo:400: Request processed in 38us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725772.414235:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725772.414253:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386752 00000100:00100000:0.0:1788725772.414257:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386752 00000100:00100000:0.0:1788725772.414287:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788725772.414294:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791386752:12345-0@lo:400: 00000100:00100000:0.0:1788725772.414322:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791386752:12345-0@lo:400: Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725772.414328:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788725772.414355:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791386752:0@lo:400: 00010000:00080000:0.0:1788725772.414367:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b138767d880 x1875614791386624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725772.414377:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791386624:0@lo:400: 00000100:00100000:3.0:1788725772.414620:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791386880:0@lo:400: 00000100:00100000:3.0:1788725772.414648:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725772.414677:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725772.414683:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791386496:0@lo:400: 00000100:00100000:3.0:1788725772.414708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725772.414898:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386880 00000100:00100000:0.0:1788725772.414903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386880 00000100:00100000:0.0:1788725772.414930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725772.414947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791386880:12345-0@lo:400: 00000100:00100000:0.0:1788725772.414984:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791386880:12345-0@lo:400: Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725772.414990:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725772.415009:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791386496 00000100:00100000:0.0:1788725772.415012:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791386496 00000100:00100000:0.0:1788725772.415036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788725772.415042:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3638:x1875614791386496:12345-0@lo:400: 00000100:00100000:0.0:1788725772.415070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3638:x1875614791386496:12345-0@lo:400: Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725772.415075:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788725772.415110:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791386496:0@lo:400: 00010000:00080000:0.0:1788725772.415157:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b138767c000 x1875614791386880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725788 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725772.415176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791386880:0@lo:400: 00010000:00010000:0.0:1788725773.189896:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788725773.696427:0:8419:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788725773.696431:0:8419:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788725773.696432:0:8419:0:(obd_mount.c:940:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788725773.696567:0:8419:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b139e52d000 00000020:01000004:2.0:1788725773.696581:0:8419:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788725773.696593:0:8419:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788725773.696622:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b139e433370) 00000020:00000080:2.0:1788725773.696637:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788725773.768581:0:8419:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788725773.768677:0:8419:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788725773.823809:0:8419:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788725773.824075:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788725773.824090:0:8419:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788725773.824105:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13c582691d36b92 00000020:01000004:0.0:1788725773.824113:0:8419:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788725773.828085:0:8419:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788725773.828094:0:8419:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788725773.828104:0:8419:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788725773.828114:0:8419:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788725773.829086:0:8419:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b13be9acd28) 00000020:00000080:0.0:1788725773.830220:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788725773.838905:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725773.839172:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788725773.839179:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788725773.840274:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788725773.840285:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788725773.840614:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788725773.840621:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788725773.842849:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788725773.843090:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788725773.843097:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788725773.845755:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788725773.845777:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788725773.869621:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725773.869919:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788725773.869927:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788725773.872704:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788725773.872724:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788725773.874424:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788725773.874442:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788725773.876837:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788725773.877078:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788725773.877085:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788725773.877867:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788725773.877877:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788725773.947449:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725773.947488:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791387008:0@lo:41: 00000100:00100000:0.0:1788725773.947584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725773.947802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387008 00000100:00100000:3.0:1788725773.947813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387008 00000100:00100000:3.0:1788725773.947880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788725773.947892:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791387008:12345-0@lo:41: 00000004:00000024:3.0:1788725773.947939:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788725773.948008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791387008:12345-0@lo:41: Request processed in 118us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725773.948037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788725773.948173:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791387008:0@lo:41: 00000100:00100000:0.0:1788725773.983498:0:8419:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788725773.985787:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788725773.985804:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788725773.992158:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788725773.992178:0:8419:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788725773.997484:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788725773.997761:0:8419:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788725773.997772:0:8419:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788725774.026058:0:8419:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788725774.026106:0:8419:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788725774.026110:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788725774.026112:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788725774.026113:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725774.026427:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725774.026430:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725774.026432:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725774.026433:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788725774.026434:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725774.026436:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725774.026437:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725774.026439:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725774.026442:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788725774.026445:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788725774.026447:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788725774.026448:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788725774.026449:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788725774.026450:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788725774.026451:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788725774.026452:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788725774.026453:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788725774.026454:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788725774.026455:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788725774.026456:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788725774.026488:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788725774.026508:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791387136:0@lo:253: 00000100:00100000:1.0:1788725774.026592:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725774.026715:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788725774.026914:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387136 00000100:00100000:3.0:1788725774.026923:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387136 00000100:00100000:3.0:1788725774.027014:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788725774.027024:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8419:x1875614791387136:12345-0@lo:253: 20000000:01000000:3.0:1788725774.027059:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788725774.027064:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788725774.027069:0:6504:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788725774.027073:0:6504:0:(mgs_llog.c:3865:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788725774.027444:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788725774.027616:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788725774.027632:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788725774.027650:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788725774.027657:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788725774.027669:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788725774.027701:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788725774.027796:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788725774.027808:0:6504:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1788725774.027809:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788725774.027822:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788725774.027826:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788725774.027837:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788725774.027842:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788725774.027851:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788725774.027857:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788725774.027867:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788725774.027880:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788725774.027938:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1788725774.027946:0:6504:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1788725774.027947:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788725774.027967:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1788725774.027972:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788725774.027982:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1788725774.027986:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788725774.027997:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1788725774.028001:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788725774.028011:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1788725774.028024:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1788725774.028630:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1788725774.028644:0:6504:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:3.0:1788725774.028646:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788725774.028657:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1788725774.028662:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788725774.028674:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1788725774.028679:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:3.0:1788725774.028707:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1788725774.028714:0:6504:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788725774.028725:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1788725774.028739:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1788725774.028751:0:6504:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788725774.028754:0:6504:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788725774.028757:0:6504:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788725774.028795:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788725774.028797:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788725774.029486:0:8437:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788725774.029518:0:8437:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788725774.029538:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788725774.029772:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788725774.029791:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788725774.029807:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788725774.029819:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788725774.029822:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788725774.030109:0:8438:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788725774.032481:0:8438:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788725774.032519:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788725774.032781:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788725774.032802:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788725774.032813:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788725774.032837:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788725774.032840:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788725774.034057:0:8439:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788725774.034091:0:8439:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788725774.034106:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788725774.034587:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788725774.034636:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788725774.034655:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788725774.034667:0:6504:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788725774.034669:0:6504:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788725774.035079:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788725774.035535:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788725774.035559:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788725774.035576:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1788725774.035617:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788725774.035636:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035655:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035663:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36adc expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035670:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b14 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035677:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b30 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035684:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035692:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035732:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035749:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.035765:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387264:0@lo:104: 00000100:00100000:3.0:1788725774.035827:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725774.035920:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.035938:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 18 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.035947:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387392:0@lo:104: 00000100:00100000:3.0:1788725774.035970:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725774.036037:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.036046:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 18 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.036054:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387520:0@lo:104: 00000100:00100000:3.0:1788725774.036074:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.036327:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387264 00000100:00100000:0.0:1788725774.036335:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387264 00000100:00100000:0.0:1788725774.036371:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387392 00000100:00100000:0.0:1788725774.036374:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387392 00000100:00100000:0.0:1788725774.036387:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725774.036396:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791387264:12345-0@lo:104: 00010000:00010000:0.0:1788725774.036408:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036464:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788725774.036470:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791387264:12345-0@lo:104: Request processed in 76us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.036476:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725774.036493:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788725774.036508:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791387392:12345-0@lo:104: 00010000:00010000:0.0:1788725774.036516:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036549:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788725774.036554:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791387392:12345-0@lo:104: Request processed in 48us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.036561:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788725774.036578:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788725774.036583:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036590:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725774.036604:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036612:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725774.036619:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725774.036624:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725774.036650:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036655:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725774.036670:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036687:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d36b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b61 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036698:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725774.036701:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036706:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179e00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725774.036709:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036716:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725774.036722:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725774.036727:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725774.036739:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036745:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725774.036750:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036755:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b37 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036764:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725774.036769:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725774.036771:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725774.036785:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791387648:0@lo:103: 00000100:00100000:0.0:1788725774.036812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.036838:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725774.036842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791387776:0@lo:103: 00000100:00100000:0.0:1788725774.036870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.036897:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387648 00000100:00100000:0.0:1788725774.036900:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387648 00010000:00010000:0.0:1788725774.036916:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 19 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.036932:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387776 00000100:00100000:0.0:1788725774.036934:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387776 00010000:00010000:0.0:1788725774.036942:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 20 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.036951:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725774.036956:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791387648:12345-0@lo:103: 00010000:00010000:0.0:1788725774.036974:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725774.036980:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 20 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.036990:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 20 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037004:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725774.037028:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791387648:12345-0@lo:103: Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.037034:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725774.037051:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788725774.037056:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3640:x1875614791387776:12345-0@lo:103: 00010000:00010000:0.0:1788725774.037063:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725774.037067:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 19 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037075:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 19 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037083:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725774.037102:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3640:x1875614791387776:12345-0@lo:103: Request processed in 46us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.037107:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788725774.037167:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791387776:0@lo:103: 00000100:00100000:0.0:1788725774.037255:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791387648:0@lo:103: 00010000:00010000:3.0:1788725774.037355:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.037366:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 18 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.037376:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387904:0@lo:104: 00000100:00100000:3.0:1788725774.037411:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725774.037440:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.037449:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.037457:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791388032:0@lo:104: 00000100:00100000:3.0:1788725774.037487:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.037497:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788725774.037510:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f600/0xa13c582691d36b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b5a expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.037519:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387264:0@lo:104: 00010000:00010000:3.0:1788725774.037528:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030400/0xa13c582691d36b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b30 expref: 17 pid: 6504 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.037536:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387392:0@lo:104: 00010000:00010000:2.0:1788725774.037606:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725774.037713:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387520 00000100:00100000:0.0:1788725774.037718:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387520 00000100:00100000:0.0:1788725774.037739:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791387904 00000100:00100000:0.0:1788725774.037742:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791387904 00000100:00100000:0.0:1788725774.037751:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388032 00000100:00100000:0.0:1788725774.037753:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388032 00000100:00100000:0.0:1788725774.037764:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725774.037770:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6504:x1875614791387520:12345-0@lo:104: 00010000:00010000:0.0:1788725774.037780:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037837:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788725774.037842:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6504:x1875614791387520:12345-0@lo:104: Request processed in 73us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.037856:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725774.037869:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725774.037875:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791387904:12345-0@lo:104: 00010000:00010000:0.0:1788725774.037882:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037916:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788725774.037921:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6504:x1875614791387904:12345-0@lo:104: Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.037927:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725774.037938:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725774.037944:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791388032:12345-0@lo:104: 00010000:00010000:0.0:1788725774.037950:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.037978:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788725774.037983:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6504:x1875614791388032:12345-0@lo:104: Request processed in 40us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.037989:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788725774.038003:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788725774.038008:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038014:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725774.038018:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038035:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725774.038041:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725774.038045:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725774.038061:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038067:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725774.038084:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038090:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b1b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038103:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788725774.038106:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038111:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725774.038113:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038272:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725774.038277:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038283:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725774.038286:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038293:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725774.038300:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725774.038305:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725774.038328:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038335:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725774.038340:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038347:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36a6c expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.038356:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725774.038358:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725774.038360:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725774.038365:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725774.038400:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725774.038407:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725774.038417:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725774.038430:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038435:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725774.038455:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038462:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ae3 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038475:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725774.038477:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725774.038478:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725774.038489:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791388160:0@lo:103: 00000100:00100000:0.0:1788725774.038517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.038545:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725774.038551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791388288:0@lo:103: 00000100:00100000:0.0:1788725774.038570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.038590:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725774.038608:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791388416:0@lo:103: 00000100:00100000:0.0:1788725774.038629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.038651:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388160 00000100:00100000:0.0:1788725774.038655:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388160 00010000:00010000:0.0:1788725774.038672:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 17 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.038686:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388288 00000100:00100000:0.0:1788725774.038693:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388288 00010000:00010000:0.0:1788725774.038703:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.038713:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388416 00000100:00100000:0.0:1788725774.038714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388416 00010000:00010000:0.0:1788725774.038732:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 19 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.038744:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725774.038749:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3638:x1875614791388160:12345-0@lo:103: 00010000:00010000:0.0:1788725774.038757:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725774.038761:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 19 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038771:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 19 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038785:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725774.038808:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3638:x1875614791388160:12345-0@lo:103: Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.038815:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788725774.038826:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725774.038831:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3638:x1875614791388288:12345-0@lo:103: 00010000:00010000:0.0:1788725774.038837:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725774.038841:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038849:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 18 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038867:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725774.038884:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3638:x1875614791388288:12345-0@lo:103: Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.038890:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725774.038901:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725774.038906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3641:x1875614791388416:12345-0@lo:103: 00010000:00010000:0.0:1788725774.038911:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725774.038915:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 17 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038924:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 17 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038934:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038941:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038954:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038961:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038968:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038974:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038984:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725774.038988:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.038996:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.039003:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.039011:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725774.039033:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3641:x1875614791388416:12345-0@lo:103: Request processed in 127us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.039038:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725774.039082:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791388288:0@lo:103: 00000100:00100000:0.0:1788725774.039089:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791388160:0@lo:103: 00000100:00100000:0.0:1788725774.039107:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791388416:0@lo:103: 00010000:00010000:3.0:1788725774.039234:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b14 expref: 16 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.039245:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387520:0@lo:104: 00010000:00010000:3.0:1788725774.039255:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148ae00/0xa13c582691d36ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36adc expref: 15 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.039263:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791387904:0@lo:104: 00010000:00010000:3.0:1788725774.039272:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f400/0xa13c582691d36a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36a65 expref: 14 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.039280:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6504:1875614791388032:0@lo:104: 00010000:00010000:3.0:1788725774.039302:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.039310:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.039317:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.039331:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36ba0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788725774.039345:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788725774.045503:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:8419:x1875614791387136:12345-0@lo:253: Request processed in 18472us (18902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.045517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788725774.045637:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791387136:0@lo:253: 10000000:01000000:2.0:1788725774.045654:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788725774.045657:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788725774.045659:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788725774.045660:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725774.045661:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788725774.045663:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725774.045665:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725774.045666:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725774.045668:0:8419:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788725774.045669:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725774.045671:0:8419:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788725774.045694:0:8419:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b139e52d000 from lustre-OST0000 10000000:01000000:2.0:1788725774.045727:0:8419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788725774.045730:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788725774.045738:0:8419:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b13a96d0000 local copy 10000000:01000000:2.0:1788725774.045742:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725774.045782:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.045813:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.045824:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.045846:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388544:0@lo:101: 00000100:00100000:2.0:1788725774.045885:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.045934:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e798240 going to sleep for 11 seconds 00000100:00100000:1.0:1788725774.045993:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388544 00000100:00100000:1.0:1788725774.046000:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388544 00000100:00100000:1.0:1788725774.046050:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788725774.046060:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+13:8419:x1875614791388544:12345-0@lo:101: 00010000:00010000:1.0:1788725774.046072:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725774.046086:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148a800/0xa13c582691d36bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ba7 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.046110:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148a800/0xa13c582691d36bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ba7 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.046143:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148a800/0xa13c582691d36bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ba7 expref: 14 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.046153:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a800, rc 0) 00000100:00100000:1.0:1788725774.046200:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791388544:12345-0@lo:101: Request processed in 141us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.046206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788725774.046651:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388544:0@lo:101: 00010000:00010000:3.0:1788725774.046692:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.046827:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.046981:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388672:0@lo:501: 00000100:00100000:3.0:1788725774.047053:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.047103:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725774.047321:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388672 00000100:00100000:1.0:1788725774.047332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388672 00000100:00100000:1.0:1788725774.047417:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725774.047438:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791388672:12345-0@lo:501: 00000100:00100000:1.0:1788725774.047543:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791388672:12345-0@lo:501: Request processed in 107us (489us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725774.047551:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788725774.047816:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388672:0@lo:501: 10000000:01000000:3.0:1788725774.047839:0:8419:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788725774.047870:0:8419:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788725774.047877:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.047887:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.047896:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.047922:0:8419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788725774.047968:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b139e52d000 10000000:01000000:3.0:1788725774.047974:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788725774.047981:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788725774.047984:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725774.047989:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788725774.047992:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788725774.048041:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.048050:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.048061:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.048077:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388800:0@lo:101: 00000100:00100000:3.0:1788725774.048160:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.050211:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d43c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788725774.052093:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725774.052110:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.052631:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725774.052638:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.052651:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725774.052661:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.053389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388800 00000100:00100000:2.0:1788725774.053405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388800 00000100:00100000:2.0:1788725774.053465:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788725774.053474:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791388800:12345-0@lo:101: 00010000:00010000:2.0:1788725774.053492:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725774.053509:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36bb5 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.053537:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.053548:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725774.053880:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725774.053930:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.053937:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725774.055368:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949ea00, rc 0) 00000100:00100000:2.0:1788725774.055465:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791388800:12345-0@lo:101: Request processed in 1988us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.055474:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788725774.056098:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791388800:0@lo:101: 00010000:00010000:2.0:1788725774.056183:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.056197:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.056368:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389056:0@lo:501: 00000100:00100000:2.0:1788725774.056456:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.056514:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e798240 going to sleep for 11 seconds 00000100:00100000:1.0:1788725774.056522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389056 00000100:00100000:1.0:1788725774.056535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389056 00000100:00100000:1.0:1788725774.056610:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788725774.056620:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389056:12345-0@lo:501: 00000100:00100000:1.0:1788725774.056766:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389056:12345-0@lo:501: Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.056773:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788725774.056880:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389056:0@lo:501: 00000100:00100000:2.0:1788725774.056928:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389184:0@lo:503: 00000100:00100000:2.0:1788725774.056981:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.057038:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e798240 going to sleep for 11 seconds 00010000:00010000:3.0:1788725774.057127:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.059578:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36bae expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.059615:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725774.059617:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725774.059620:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725774.060348:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725774.060384:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791388928:0@lo:103: 00000100:00100000:0.0:1788725774.060836:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389184 00000100:00100000:0.0:1788725774.060851:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389184 00000100:00100000:1.0:1788725774.061067:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788725774.061081:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389184:12345-0@lo:503: 00000100:00100000:1.0:1788725774.061365:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389184:12345-0@lo:503: Request processed in 288us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.061373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788725774.061533:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389184:0@lo:503: 00000100:00100000:3.0:1788725774.061561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788725774.061846:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725774.061942:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389312:0@lo:502: 00000100:00100000:2.0:1788725774.061996:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.062033:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725774.062111:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791388928 00000100:00100000:1.0:1788725774.062280:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791388928 00000100:00100000:1.0:1788725774.062321:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725774.062328:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3640:x1875614791388928:12345-0@lo:103: 00010000:00010000:1.0:1788725774.062338:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725774.062355:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148a800/0xa13c582691d36bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36ba7 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.062368:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725774.062629:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:3640:x1875614791388928:12345-0@lo:103: Request processed in 300us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.062650:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788725774.062660:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389312 00000100:00100000:3.0:1788725774.062674:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389312 00000100:00100000:1.0:1788725774.062701:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791388928:0@lo:103: 00000100:00100000:3.0:1788725774.062739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788725774.062749:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791389312:12345-0@lo:502: 00000100:00100000:3.0:1788725774.062940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791389312:12345-0@lo:502: Request processed in 192us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725774.062949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788725774.062987:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389312:0@lo:502: 00000040:00080000:0.0:1788725774.063403:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788725774.063436:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788725774.063447:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788725774.063459:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788725774.063471:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788725774.063483:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788725774.063512:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389440:0@lo:502: 00000100:00100000:0.0:1788725774.063572:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.063624:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.063724:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389440 00000100:00100000:2.0:1788725774.063730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389440 00000100:00100000:2.0:1788725774.063769:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725774.063777:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791389440:12345-0@lo:502: 00000100:00100000:2.0:1788725774.063964:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791389440:12345-0@lo:502: Request processed in 188us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.063971:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788725774.068384:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389440:0@lo:502: 00000040:00080000:2.0:1788725774.068992:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788725774.069020:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788725774.069801:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788725774.069811:0:8441:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788725774.069817:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725774.069820:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788725774.069825:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725774.069840:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b139e434d28) 00000020:00000080:2.0:1788725774.069874:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788725774.069881:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788725774.069965:0:8441:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139e52d000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788725774.069973:0:8441:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788725774.069980:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13c582691d36bca 00010000:00010000:3.0:1788725774.075867:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788725774.076348:0:8441:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788725774.080630:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788725774.080956:0:8441:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788725774.088882:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788725774.089038:0:8441:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788725774.102612:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788725774.104949:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788725774.104975:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725774.104982:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725774.104985:0:8441:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788725774.104988:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725774.104992:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725774.104994:0:8441:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725774.104997:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725774.104999:0:8441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788725774.105018:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725774.105022:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725774.105023:0:8441:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725774.105026:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788725774.105362:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788725774.105392:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788725774.105419:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105431:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725774.105440:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e52d000 from 1 10000000:01000000:2.0:1788725774.105443:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725774.105476:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105485:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105495:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.105518:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389568:0@lo:101: 00000100:00100000:2.0:1788725774.105590:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.105639:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.105664:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389568 00000100:00100000:2.0:1788725774.105671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389568 00000100:00100000:2.0:1788725774.105711:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788725774.105720:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:8419:x1875614791389568:12345-0@lo:101: 00010000:00010000:2.0:1788725774.105734:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725774.105745:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36bd1 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105767:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105777:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 15 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105785:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:2.0:1788725774.105824:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389568:12345-0@lo:101: Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.105830:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788725774.105877:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389568:0@lo:101: 00010000:00010000:2.0:1788725774.105890:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.105899:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.105969:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389696:0@lo:501: 00000100:00100000:2.0:1788725774.106006:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.106027:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.106046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389696 00000100:00100000:2.0:1788725774.106050:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389696 00000100:00100000:2.0:1788725774.106077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788725774.106084:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389696:12345-0@lo:501: 00000100:00100000:2.0:1788725774.106335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389696:12345-0@lo:501: Request processed in 251us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.106343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788725774.106381:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389696:0@lo:501: 00000100:00100000:2.0:1788725774.106410:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389824:0@lo:503: 00000100:00100000:2.0:1788725774.106450:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.106469:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.106484:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389824 00000100:00100000:2.0:1788725774.106488:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389824 00000100:00100000:2.0:1788725774.106510:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725774.106517:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389824:12345-0@lo:503: 00000100:00100000:2.0:1788725774.106607:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389824:12345-0@lo:503: Request processed in 89us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.106614:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725774.106656:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389824:0@lo:503: 00000040:00080000:2.0:1788725774.106898:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725774.106983:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389952:0@lo:502: 00000100:00100000:2.0:1788725774.107017:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725774.107031:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.107046:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791389952 00000100:00100000:2.0:1788725774.107056:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791389952 00000100:00100000:2.0:1788725774.107081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725774.107088:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389952:12345-0@lo:502: 00000100:00100000:2.0:1788725774.107535:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791389952:12345-0@lo:502: Request processed in 446us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.107543:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788725774.109711:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791389952:0@lo:502: 00000040:00080000:0.0:1788725774.109948:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788725774.109980:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788725774.110016:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390080:0@lo:502: 00000100:00100000:0.0:1788725774.110077:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.110365:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e6979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.110433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390080 00000100:00100000:2.0:1788725774.110441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390080 00000100:00100000:2.0:1788725774.110490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788725774.110501:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791390080:12345-0@lo:502: 00000100:00100000:2.0:1788725774.110622:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791390080:12345-0@lo:502: Request processed in 122us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.110631:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788725774.111231:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390080:0@lo:502: 00000040:00080000:1.0:1788725774.111356:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788725774.111368:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788725774.120346:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725774.120360:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725774.120362:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788725774.120372:0:8445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139e52d000 00000020:00000080:3.0:1788725774.120374:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788725774.120385:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725774.120388:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725774.120390:0:8445:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788725774.120393:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788725774.124814:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788725774.124864:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788725774.124893:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.124906:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725774.124969:0:8419:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788725774.124972:0:8419:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b139e52d000 10000000:01000000:3.0:1788725774.124975:0:8419:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b139e52d000 10000000:01000000:3.0:1788725774.124979:0:8419:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725774.124984:0:8419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139e52d000 from 1 10000000:01000000:3.0:1788725774.124987:0:8419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725774.125020:0:8419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.125028:0:8419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.125057:0:8419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.125080:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390208:0@lo:101: 00000100:00100000:3.0:1788725774.125177:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.125221:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725774.126575:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390208 00000100:00100000:3.0:1788725774.126585:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390208 00000100:00100000:3.0:1788725774.126648:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788725774.126657:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8419:x1875614791390208:12345-0@lo:101: 00010000:00010000:3.0:1788725774.126674:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725774.126688:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36bdf expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.126711:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36bdf expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.126722:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bdf expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.126731:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178e00, rc 0) 00000100:00100000:3.0:1788725774.126783:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390208:12345-0@lo:101: Request processed in 126us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725774.126790:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788725774.126838:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390208:0@lo:101: 00010000:00010000:3.0:1788725774.126853:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.126879:0:8419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.126981:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390336:0@lo:501: 00000100:00100000:3.0:1788725774.127012:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.127038:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788725774.127291:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390336 00000100:00100000:0.0:1788725774.127296:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390336 00000100:00100000:0.0:1788725774.127324:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788725774.127331:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390336:12345-0@lo:501: 00000100:00100000:0.0:1788725774.127431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390336:12345-0@lo:501: Request processed in 101us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.127438:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788725774.127470:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390336:0@lo:501: 00000100:00100000:0.0:1788725774.127506:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390464:0@lo:503: 00000100:00100000:0.0:1788725774.127543:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.127555:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e6979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725774.127567:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390464 00000100:00100000:0.0:1788725774.127571:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390464 00000100:00100000:0.0:1788725774.127591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788725774.127608:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390464:12345-0@lo:503: 00000100:00100000:0.0:1788725774.127679:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390464:12345-0@lo:503: Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.127685:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788725774.127724:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390464:0@lo:503: 00000040:00080000:0.0:1788725774.127926:0:8419:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788725774.128364:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390592:0@lo:502: 00000100:00100000:0.0:1788725774.128401:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.128429:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.128504:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390592 00000100:00100000:2.0:1788725774.128509:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390592 00000100:00100000:2.0:1788725774.128541:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788725774.128549:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390592:12345-0@lo:502: 00000100:00100000:2.0:1788725774.128647:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390592:12345-0@lo:502: Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.128654:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788725774.128721:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390592:0@lo:502: 00000040:00080000:1.0:1788725774.128930:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788725774.128958:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788725774.130103:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788725774.130207:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788725774.130226:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788725774.130242:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788725774.130255:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788725774.130270:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788725774.130285:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788725774.130307:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788725774.130325:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788725774.130339:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788725774.130350:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788725774.130362:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788725774.130374:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788725774.130389:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788725774.130404:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788725774.130418:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788725774.130432:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788725774.130448:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788725774.130462:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788725774.130491:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788725774.130507:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788725774.130523:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788725774.130538:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788725774.130552:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788725774.130565:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788725774.130577:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788725774.130589:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788725774.130614:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788725774.130630:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788725774.130643:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788725774.130658:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788725774.130672:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788725774.130687:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788725774.130717:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788725774.130735:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788725774.130776:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390720:0@lo:502: 00000100:00100000:1.0:1788725774.130838:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725774.130870:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725774.131051:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390720 00000100:00100000:2.0:1788725774.131057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390720 00000100:00100000:2.0:1788725774.131103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788725774.131113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390720:12345-0@lo:502: 00000100:00100000:2.0:1788725774.131244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791390720:12345-0@lo:502: Request processed in 132us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725774.131252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788725774.132553:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791390720:0@lo:502: 00000040:00080000:1.0:1788725774.132638:0:8419:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788725774.132651:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788725774.134839:0:8446:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788725774.134857:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b13be5d8000) 00000020:00000080:3.0:1788725774.134880:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788725774.134984:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139e52d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788725774.134989:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139e52d000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788725774.134991:0:8446:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139e52d000 3 00010000:00080000:3.0:1788725774.135019:0:8446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1282104000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788725774.137841:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788725774.138346:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788725774.138388:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788725774.138400:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa13c582691d36bf4 00000100:00080000:3.0:1788725774.138410:0:8446:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725774.138416:0:8446:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b1282104000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725774.138449:0:8446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1281a29180 x1875614791390848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788725774.138477:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788725774.138543:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791390848:0@lo:38: 00000100:00100000:2.0:1788725774.138620:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788725774.138981:0:8446:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788725774.138994:0:8446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b139e430000) 00000020:00000080:2.0:1788725774.139008:0:8446:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788725774.139072:0:8446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139e52d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788725774.139076:0:8446:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139e52d000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788725774.139079:0:8446:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139e52d000 3 00010000:00080000:2.0:1788725774.139104:0:8446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1281a3f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788725774.144658:0:8446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788725774.144850:0:8446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788725774.144893:0:8446:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788725774.144907:0:8446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa13c582691d36c02 00000100:00080000:2.0:1788725774.144916:0:8446:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788725774.144922:0:8446:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b1281a3f800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788725774.147054:0:8446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13842ac700 x1875614791390976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725774.147094:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791390976:0@lo:38: 00000100:00100000:0.0:1788725774.147295:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390848 00000100:00100000:0.0:1788725774.147303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390848 00000100:00100000:0.0:1788725774.147338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788725774.147346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791390848:12345-0@lo:38: 00010000:00080000:0.0:1788725774.147371:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1788725774.147401:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa13c582691d36c09 00000004:00100000:0.0:1788725774.147414:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788725774.147444:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9b139f766000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725774.147517:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875614791390848:12345-0@lo:38: Request processed in 170us (8896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.147525:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788725774.147558:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791391104:0@lo:400: 00000100:00100000:0.0:1788725774.147587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.147623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725774.147629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791391232:0@lo:400: 00000100:00100000:0.0:1788725774.147651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.147678:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725774.147691:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791391360:0@lo:400: 00000100:00100000:0.0:1788725774.147715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725774.147743:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391104 00000100:00100000:0.0:1788725774.147747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391104 00000100:00100000:0.0:1788725774.147769:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391232 00000100:00100000:0.0:1788725774.147772:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391232 00000100:00100000:0.0:1788725774.147784:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725774.147790:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791391104:12345-0@lo:400: 00000100:00100000:0.0:1788725774.147825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791391104:12345-0@lo:400: Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.147832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725774.147845:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725774.147851:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791391232:12345-0@lo:400: 00000100:00100000:0.0:1788725774.147877:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791391232:12345-0@lo:400: Request processed in 26us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.147883:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725774.147905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391360 00000100:00100000:0.0:1788725774.147908:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391360 00000100:00100000:0.0:1788725774.147931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788725774.147938:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791391360:12345-0@lo:400: 00000100:00100000:2.0:1788725774.148073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788725774.148113:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1281a29180 x1875614791390848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725774.148209:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788725774.148218:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788725774.148226:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788725774.148231:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788725774.148233:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788725774.148239:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791390848:0@lo:38: 00000100:00080000:2.0:1788725774.148269:0:8446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788725774.149086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791391360:12345-0@lo:400: Request processed in 1143us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.149103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788725774.149227:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1281a05880 x1875614791391232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725774.149239:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791391232:0@lo:400: 00010000:00080000:0.0:1788725774.149250:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1281a05500 x1875614791391104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725774.149257:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791391104:0@lo:400: 00000100:00100000:0.0:1788725774.149284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791390976 00000100:00100000:0.0:1788725774.149289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791390976 00000100:00100000:0.0:1788725774.149312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725774.149317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875614791390976:12345-0@lo:38: 00010000:00080000:0.0:1788725774.149336:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1788725774.149365:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa13c582691d36c10 00000004:00100000:0.0:1788725774.149376:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788725774.149401:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9b139f761800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725774.149446:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875614791390976:12345-0@lo:38: Request processed in 128us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725774.149453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725774.149603:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791391360:0@lo:400: 00010000:00080000:2.0:1788725774.149678:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b13842ac700 x1875614791390976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725774.149686:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788725774.149692:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788725774.149698:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788725774.149701:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788725774.149703:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788725774.149708:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791390976:0@lo:38: 00000040:00080000:2.0:1788725774.149817:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788725774.150040:0:8419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788725774.150071:0:8419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725774.150090:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725774.150112:0:8419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788725774.150774:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788725774.150776:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788725774.150778:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725774.150779:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725774.150781:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725774.150782:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725774.150784:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725774.150786:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725774.150787:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725774.150789:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725774.150790:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725774.150795:0:8419:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788725774.150797:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788725774.150799:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788725774.150800:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725774.150801:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725774.150802:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725774.150803:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725774.150804:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725774.150805:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725774.150807:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725774.150808:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725774.150809:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788725774.150832:0:8419:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788725774.150848:0:8419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791391488:0@lo:253: 00000100:00100000:3.0:1788725774.150902:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725774.150933:0:8419:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13864810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725774.151042:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391488 00000100:00100000:0.0:1788725774.151048:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391488 00000100:00100000:0.0:1788725774.151093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788725774.151103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791391488:12345-0@lo:253: 20000000:01000000:0.0:1788725774.151274:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788725774.151290:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788725774.163203:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788725774.163223:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788725774.163456:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788725774.163474:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788725774.163496:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.163515:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b06 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.163521:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.163528:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.163560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:8419:x1875614791391488:12345-0@lo:253: Request processed in 12457us (12655us total) trans 0 rc 0/0 00010000:00010000:0.0:1788725774.163563:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.163570:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:0.0:1788725774.163575:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725774.163689:0:8419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8419:1875614791391488:0@lo:253: 10000000:01000000:3.0:1788725774.163703:0:8419:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788725774.163707:0:8419:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788725774.163708:0:8419:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788725774.163716:0:8419:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725774.163718:0:8419:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725774.163719:0:8419:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725774.163720:0:8419:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725774.163721:0:8419:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725774.163723:0:8419:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725774.163724:0:8419:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725774.163725:0:8419:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725774.163727:0:8419:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788725774.163742:0:8419:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788725774.163846:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791391616:0@lo:104: 00000100:00100000:0.0:1788725774.163883:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725774.163932:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725774.163940:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 15 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725774.163949:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791391744:0@lo:104: 00000100:00100000:0.0:1788725774.163966:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725774.164177:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788725774.164195:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725774.164215:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391616 00000100:00100000:1.0:1788725774.164221:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391616 00000100:00100000:1.0:1788725774.164263:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391744 00000100:00100000:1.0:1788725774.164267:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391744 00000100:00100000:1.0:1788725774.164281:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725774.164289:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13bd494450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791391616:12345-0@lo:104: 00010000:00010000:1.0:1788725774.164300:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164354:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725774.164360:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13bd494450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791391616:12345-0@lo:104: Request processed in 72us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.164367:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725774.164398:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725774.164405:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791391744:12345-0@lo:104: 00010000:00010000:1.0:1788725774.164413:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164443:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725774.164447:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791391744:12345-0@lo:104: Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.164452:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788725774.164468:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788725774.164474:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164482:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788725774.164486:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164494:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725774.164502:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725774.164508:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788725774.164538:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164545:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725774.164563:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164570:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b29 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164582:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725774.164585:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164590:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788725774.164603:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164610:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725774.164617:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725774.164622:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788725774.164633:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164640:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725774.164653:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164669:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2178400/0xa13c582691d36b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b0d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164683:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725774.164684:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725774.164686:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725774.164692:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725774.164704:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791391872:0@lo:103: 00000100:00100000:1.0:1788725774.164731:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725774.164764:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791392000:0@lo:103: 00000100:00100000:1.0:1788725774.164786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725774.164816:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791391872 00000100:00100000:1.0:1788725774.164821:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791391872 00010000:00010000:1.0:1788725774.164837:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 16 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725774.164855:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392000 00000100:00100000:1.0:1788725774.164858:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392000 00010000:00010000:1.0:1788725774.164867:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725774.164879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725774.164885:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3641:x1875614791391872:12345-0@lo:103: 00010000:00010000:1.0:1788725774.164894:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725774.164900:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164910:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 17 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.164931:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725774.164971:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3641:x1875614791391872:12345-0@lo:103: Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.164977:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725774.164990:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725774.164996:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3638:x1875614791392000:12345-0@lo:103: 00010000:00010000:1.0:1788725774.165003:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725774.165008:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 16 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165017:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 16 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165028:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165036:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788725774.165048:0:6497:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022115605s 00010000:00010000:1.0:1788725774.165052:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165059:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165066:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165072:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165083:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788725774.165087:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165095:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165104:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725774.165113:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725774.165158:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3638:x1875614791392000:12345-0@lo:103: Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725774.165165:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725774.165194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791392000:0@lo:103: 00000100:00100000:1.0:1788725774.165214:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791391872:0@lo:103: 00010000:00010000:2.0:1788725774.166736:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380031c00/0xa13c582691d36b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b22 expref: 15 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.166753:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791391616:0@lo:104: 00010000:00010000:2.0:1788725774.166765:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030a00/0xa13c582691d36b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b06 expref: 14 pid: 6505 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725774.166773:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791391744:0@lo:104: 00010000:00010000:2.0:1788725774.166792:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.166801:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.166821:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725774.166827:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af000/0xa13c582691d36c17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788725774.172097:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788725774.172357:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788725774.172537:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788725774.172713:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788725774.172901:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788725774.173528:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788725774.175751:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788725774.188582:0:8419:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788725774.188610:0:8419:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788725774.188650:0:8419:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788725774.188692:0:8419:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788725774.188713:0:8419:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788725774.188730:0:8419:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788725774.193190:0:8419:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788725774.193359:0:8419:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788725774.210232:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725775.042974:0:8503:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725775.044382:0:8503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788725775.231337:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725776.255945:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725777.275444:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725777.531339:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791392128:0@lo:41: 00000100:00100000:3.0:1788725777.531435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725777.531506:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392128 00000100:00100000:3.0:1788725777.531513:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392128 00000100:00100000:3.0:1788725777.531554:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725777.531563:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791392128:12345-0@lo:41: 00000004:00000024:3.0:1788725777.531607:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788725777.531648:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791392128:12345-0@lo:41: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725777.531656:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725777.531699:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791392128:0@lo:41: 00010000:00010000:1.0:1788725778.304330:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788725779.067310:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788725779.067322:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b13bd660800 from 30 10000000:01000000:2.0:1788725779.067330:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725779.067397:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.067410:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.067424:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725779.067457:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392256:0@lo:101: 00000100:00100000:2.0:1788725779.067547:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.067691:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.067871:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392256 00000100:00100000:0.0:1788725779.067883:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392256 00000100:00100000:0.0:1788725779.067979:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788725779.067990:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:6509:x1875614791392256:12345-0@lo:101: 00010000:00010000:0.0:1788725779.068006:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725779.068022:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c1e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.068048:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c1e expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.068058:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c1e expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.068069:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae800, rc 0) 00000100:00100000:0.0:1788725779.068145:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791392256:12345-0@lo:101: Request processed in 156us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.068152:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788725779.068360:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791392384:0@lo:41: 00000100:00100000:1.0:1788725779.068402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.070407:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392256:0@lo:101: 00010000:00010000:2.0:1788725779.070444:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.070459:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725779.070585:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392512:0@lo:501: 00000100:00100000:2.0:1788725779.070654:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.075833:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788725779.077766:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392512 00000100:00100000:3.0:1788725779.077791:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392512 00000100:00100000:3.0:1788725779.077883:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788725779.077898:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791392512:12345-0@lo:501: 00000100:00100000:3.0:1788725779.078171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791392512:12345-0@lo:501: Request processed in 276us (7516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.078655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392384 00000100:00100000:0.0:1788725779.078663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392384 00000100:00100000:0.0:1788725779.078778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725779.078788:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791392384:12345-0@lo:41: 00000004:00000024:0.0:1788725779.078824:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788725779.078960:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791392384:12345-0@lo:41: Request processed in 173us (10556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.078976:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725779.079379:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791392384:0@lo:41: 00000100:00100000:3.0:1788725779.079678:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788725779.080463:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392512:0@lo:501: 00000100:00100000:3.0:1788725779.080538:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392640:0@lo:503: 00000100:00100000:3.0:1788725779.081363:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.081445:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.081492:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392640 00000100:00100000:2.0:1788725779.081502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392640 00000100:00100000:2.0:1788725779.081665:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788725779.081677:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791392640:12345-0@lo:503: 00000100:00100000:2.0:1788725779.081839:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791392640:12345-0@lo:503: Request processed in 164us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.081848:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788725779.081931:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791392640:0@lo:503: 00000100:00100000:3.0:1788725779.082334:0:8699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8699:1875614791392768:0@lo:502: 00000100:00100000:3.0:1788725779.082381:0:8699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.082449:0:8699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.082492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392768 00000100:00100000:2.0:1788725779.082498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392768 00000100:00100000:2.0:1788725779.082641:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788725779.082651:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8699:x1875614791392768:12345-0@lo:502: 00000100:00100000:2.0:1788725779.082762:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8699:x1875614791392768:12345-0@lo:502: Request processed in 112us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.082770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788725779.082793:0:8699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8699:1875614791392768:0@lo:502: 00000100:00100000:1.0:1788725779.082910:0:8699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8699:1875614791392896:0@lo:502: 00000100:00100000:1.0:1788725779.082950:0:8699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.082974:0:8699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.083083:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791392896 00000100:00100000:2.0:1788725779.083087:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791392896 00000100:00100000:2.0:1788725779.083145:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788725779.083153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8699:x1875614791392896:12345-0@lo:502: 00000100:00100000:2.0:1788725779.083228:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:8699:x1875614791392896:12345-0@lo:502: Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.083234:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788725779.083347:0:8699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8699:1875614791392896:0@lo:502: 00000040:00080000:1.0:1788725779.083367:0:8699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788725779.083658:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788725779.083682:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725779.083694:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.083706:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725779.083716:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788725779.083720:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b13bd660800 from 5 10000000:01000000:3.0:1788725779.083723:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725779.083764:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.083774:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.083785:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725779.083807:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393024:0@lo:101: 00000100:00100000:3.0:1788725779.083844:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.083880:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.083931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393024 00000100:00100000:2.0:1788725779.083936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393024 00000100:00100000:2.0:1788725779.083966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788725779.083974:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791393024:12345-0@lo:101: 00010000:00010000:2.0:1788725779.083984:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725779.083999:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c2c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.084022:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c2c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.084033:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c2c expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.084043:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fc00, rc 0) 00000100:00100000:2.0:1788725779.084079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791393024:12345-0@lo:101: Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.084085:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788725779.084166:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393024:0@lo:101: 00010000:00010000:3.0:1788725779.084251:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.084262:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725779.084313:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393152:0@lo:256: 00000100:00100000:3.0:1788725779.084348:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.084370:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.084430:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393152 00000100:00100000:2.0:1788725779.084435:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393152 00000100:00100000:2.0:1788725779.084463:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788725779.084470:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791393152:12345-0@lo:256: 20000000:01000000:2.0:1788725779.084486:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788725779.084506:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788725779.084510:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788725779.084716:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791393152:12345-0@lo:256: Request processed in 245us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.084723:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725779.084813:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393152:0@lo:256: 10000000:01000000:1.0:1788725779.084867:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788725779.084873:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.084882:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725779.084891:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788725779.084893:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788725779.084896:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788725779.084917:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.084925:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.084932:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725779.084946:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393280:0@lo:101: 00000100:00100000:1.0:1788725779.084975:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.085040:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725779.085074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393280 00000100:00100000:3.0:1788725779.085079:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393280 00000100:00100000:3.0:1788725779.085262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788725779.085275:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791393280:12345-0@lo:101: 00010000:00010000:3.0:1788725779.085285:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725779.085298:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c3a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.085316:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c3a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.085325:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c3a expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.085343:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178600, rc 0) 00000100:00100000:3.0:1788725779.085459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791393280:12345-0@lo:101: Request processed in 186us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725779.085465:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788725779.085528:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393280:0@lo:101: 00010000:00010000:1.0:1788725779.085542:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.085551:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725779.085714:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393408:0@lo:501: 00000100:00100000:1.0:1788725779.085743:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.085810:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.085841:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393408 00000100:00100000:2.0:1788725779.085845:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393408 00000100:00100000:2.0:1788725779.085918:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788725779.085926:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791393408:12345-0@lo:501: 00000100:00100000:2.0:1788725779.086076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791393408:12345-0@lo:501: Request processed in 150us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.086083:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788725779.086152:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393408:0@lo:501: 00000100:00100000:1.0:1788725779.086192:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393536:0@lo:503: 00000100:00100000:1.0:1788725779.086236:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.086417:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725779.086446:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393536 00000100:00100000:3.0:1788725779.086450:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393536 00000100:00100000:3.0:1788725779.086474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788725779.086480:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791393536:12345-0@lo:503: 00000100:00100000:3.0:1788725779.086677:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791393536:12345-0@lo:503: Request processed in 195us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725779.086684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788725779.086762:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791393536:0@lo:503: 00000100:00100000:3.0:1788725779.087168:0:8700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8700:1875614791393664:0@lo:502: 00000100:00100000:3.0:1788725779.087286:0:8700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.087309:0:8700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138541fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.087376:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393664 00000100:00100000:1.0:1788725779.087381:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393664 00000100:00100000:1.0:1788725779.087406:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788725779.087415:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8700:x1875614791393664:12345-0@lo:502: 00000100:00100000:1.0:1788725779.087518:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8700:x1875614791393664:12345-0@lo:502: Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.087526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788725779.087800:0:8700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8700:1875614791393664:0@lo:502: 00000020:01000000:1.0:1788725779.087831:0:8700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788725779.087840:0:8700:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788725779.087850:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725779.087853:0:8700:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788725779.087858:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788725779.087862:0:8700:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788725779.087889:0:8700:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788725779.087891:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788725779.087919:0:8700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b13bd49cd28) 00000020:00000080:1.0:1788725779.087946:0:8700:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788725779.087953:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788725779.088048:0:8700:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788725779.088056:0:8700:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788725779.088064:0:8700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36c4f 00010000:00080000:1.0:1788725779.088100:0:8700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1281a14800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788725779.088679:0:8700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788725779.113244:0:8700:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788725779.113271:0:8700:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788725779.114809:0:8700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725779.115081:0:8700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725779.115199:0:8700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788725779.115300:0:8700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788725779.119629:0:8701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725779.119642:0:8701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788725779.123761:0:8700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788725779.123779:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788725779.123837:0:8700:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788725779.123867:0:8700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36c56 00000100:00080000:0.0:1788725779.123880:0:8700:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788725779.123887:0:8700:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b1281a14800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725779.123933:0:8700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1281a04a80 x1875614791393792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788725779.123965:0:8700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788725779.124053:0:8700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725779.124059:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725779.124061:0:8700:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788725779.124065:0:8700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725779.124070:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725779.124072:0:8700:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725779.124075:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725779.124078:0:8700:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788725779.124153:0:8700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8700:1875614791394048:0@lo:502: 00000100:00100000:1.0:1788725779.124191:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791393920:0@lo:400: 00000100:00100000:0.0:1788725779.124275:0:8700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.124284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.124341:0:8700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387ebcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.124385:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791393792:0@lo:8: 00000100:00100000:2.0:1788725779.124433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.126312:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393792 00000100:00100000:0.0:1788725779.126334:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393792 00000100:00100000:0.0:1788725779.126403:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725779.126414:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791393792:12345-0@lo:8: 00010000:00080000:0.0:1788725779.126467:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788725779.126508:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36c5d 00002000:00100000:0.0:1788725779.126573:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b13abd38800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788725779.126578:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788725779.126583:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788725779.126670:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788725779.126918:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788725779.126953:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b13abd3e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725779.127051:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791393792:12345-0@lo:8: Request processed in 636us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.127059:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788725779.127250:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a04a80 x1875614791393792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725779.127264:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788725779.127274:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788725779.127282:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788725779.127289:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788725779.127291:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1281a14800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788725779.127305:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788725779.127311:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791393792:0@lo:8: 00000100:00100000:2.0:1788725779.127375:0:8702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791394688:0@lo:700: 00000100:00100000:2.0:1788725779.127412:0:8702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.127432:0:8702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.127513:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394688 00000100:00100000:0.0:1788725779.127518:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394688 00000100:00100000:0.0:1788725779.127578:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725779.127587:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8702:x1875614791394688:12345-0@lo:700: 00000100:00100000:0.0:1788725779.127620:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875614791394816:0@lo:700: 00000100:00100000:0.0:1788725779.127652:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.127676:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13880193c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788725779.127696:0:8701:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788725779.127761:0:8701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 224283643130ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788725779.127767:0:8701:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788725779.132002:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394816 00000100:00100000:1.0:1788725779.132016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394816 00000100:00100000:1.0:1788725779.132080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788725779.132090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875614791394816:12345-0@lo:700: 00000100:00100000:1.0:1788725779.132273:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791394432:0@lo:400: 00000100:00100000:1.0:1788725779.132371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.132429:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791394176:0@lo:400: 00000100:00100000:1.0:1788725779.132464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.132496:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725779.132505:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791394304:0@lo:400: 00000100:00100000:1.0:1788725779.132539:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788725779.132668:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725779.132680:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725779.132787:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394048 00000100:00100000:1.0:1788725779.132794:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394048 00000100:00100000:1.0:1788725779.132855:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788725779.132865:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8700:x1875614791394048:12345-0@lo:502: 00000100:00100000:1.0:1788725779.133030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:8700:x1875614791394048:12345-0@lo:502: Request processed in 159us (8755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.133041:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788725779.133100:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791393920 00000100:00100000:1.0:1788725779.133105:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791393920 00000100:00100000:1.0:1788725779.133161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394432 00000100:00100000:1.0:1788725779.133165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394432 00000100:00100000:1.0:1788725779.133178:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394176 00000100:00100000:1.0:1788725779.133181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394176 00000100:00100000:1.0:1788725779.133194:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788725779.133201:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791393920:12345-0@lo:400: 00000100:00100000:2.0:1788725779.133265:0:8700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8700:1875614791394048:0@lo:502: 00000020:01000000:2.0:1788725779.133636:0:8700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725779.133650:0:8700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725779.133653:0:8700:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788725779.133658:0:8700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788725779.135203:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788725779.135251:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788725779.135266:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135282:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725779.135316:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788725779.135320:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139116a000 from 30 10000000:01000000:0.0:1788725779.135324:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1788725779.135349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791393920:12345-0@lo:400: Request processed in 2137us (11066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.135366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788725779.135373:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135384:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135398:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725779.135409:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788725779.135425:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791394944:0@lo:101: 00000100:00100000:1.0:1788725779.135428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3640:x1875614791394432:12345-0@lo:400: 00000100:00100000:0.0:1788725779.135516:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.135590:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1388019780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.135620:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394944 00000100:00100000:0.0:1788725779.135629:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394944 00000100:00100000:0.0:1788725779.135682:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788725779.135691:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791394944:12345-0@lo:101: 00010000:00010000:0.0:1788725779.135705:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725779.135720:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c64 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135749:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c64 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135759:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c64 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135781:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af600, rc 0) 00000100:00100000:0.0:1788725779.135822:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791394944:12345-0@lo:101: Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.135829:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788725779.135883:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791394944:0@lo:101: 00010000:00010000:0.0:1788725779.135898:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.135907:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.135972:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395072:0@lo:501: 00000100:00100000:0.0:1788725779.136000:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.136017:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1388019780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.136353:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3640:x1875614791394432:12345-0@lo:400: Request processed in 132us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.136368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788725779.136395:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788725779.136406:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791394176:12345-0@lo:400: 00000100:00100000:1.0:1788725779.136471:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791394176:12345-0@lo:400: Request processed in 69us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.136477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788725779.136732:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422ce00 x1875614791394176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.136749:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791394176:0@lo:400: 00000100:00100000:1.0:1788725779.136965:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395072 00000100:00100000:1.0:1788725779.136980:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395072 00000100:00100000:1.0:1788725779.137023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788725779.137031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791395072:12345-0@lo:501: 00000100:00100000:1.0:1788725779.137174:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791395072:12345-0@lo:501: Request processed in 144us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.137182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788725779.137249:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422e300 x1875614791393920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725779.137270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791393920:0@lo:400: 00000100:00100000:1.0:1788725779.137281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791394560:0@lo:400: 00000100:00100000:0.0:1788725779.137354:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395072:0@lo:501: 00000100:00100000:0.0:1788725779.137407:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395200:0@lo:503: 00000100:00100000:0.0:1788725779.137479:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.137523:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1388019780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.137546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395200 00000100:00100000:0.0:1788725779.137553:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395200 00000100:00100000:0.0:1788725779.137618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788725779.137628:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791395200:12345-0@lo:503: 00000100:00100000:0.0:1788725779.137753:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791395200:12345-0@lo:503: Request processed in 125us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.137761:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788725779.137809:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395200:0@lo:503: 00010000:00080000:2.0:1788725779.137873:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422e680 x1875614791394432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725779.137887:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791394432:0@lo:400: 00000100:00100000:2.0:1788725779.138449:0:8703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8703:1875614791395328:0@lo:502: 00000100:00100000:2.0:1788725779.138501:0:8703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.138532:0:8703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.138823:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395328 00000100:00100000:1.0:1788725779.138829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.138832:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395328 00000100:00100000:0.0:1788725779.138884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788725779.138895:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8703:x1875614791395328:12345-0@lo:502: 00000100:00100000:3.0:1788725779.139026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394304 00000100:00100000:3.0:1788725779.139033:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394304 00000100:00100000:0.0:1788725779.139043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8703:x1875614791395328:12345-0@lo:502: Request processed in 147us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.139053:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788725779.139083:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788725779.139096:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791394304:12345-0@lo:400: 00000100:00100000:2.0:1788725779.139292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791394560 00000100:00100000:2.0:1788725779.139302:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791394560 00000100:00100000:2.0:1788725779.139355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788725779.139365:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791394560:12345-0@lo:400: 00000100:00100000:2.0:1788725779.139429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791394560:12345-0@lo:400: Request processed in 66us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.139436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788725779.139474:0:8703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8703:1875614791395328:0@lo:502: 00000100:00100000:2.0:1788725779.139536:0:8703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8703:1875614791395456:0@lo:502: 00000100:00100000:2.0:1788725779.139710:0:8703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.139736:0:8703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236dcc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788725779.139803:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725779.139845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791394304:12345-0@lo:400: Request processed in 750us (7302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725779.139858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788725779.139878:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422d180 x1875614791394560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725779.139893:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791394560:0@lo:400: 00000004:00080000:1.0:1788725779.140015:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788725779.140352:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395456 00000100:00100000:0.0:1788725779.140361:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395456 00000100:00100000:0.0:1788725779.140410:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788725779.140420:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8703:x1875614791395456:12345-0@lo:502: 00000100:00100000:0.0:1788725779.140553:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:8703:x1875614791395456:12345-0@lo:502: Request processed in 134us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.140576:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788725779.140633:0:8703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8703:1875614791395456:0@lo:502: 00000040:00080000:0.0:1788725779.140668:0:8703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:3.0:1788725779.141951:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791394304:0@lo:400: 40000000:02000000:3.0:1788725779.143091:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:2.0:1788725779.145716:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788725779.145768:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725779.145781:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.145814:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725779.145879:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788725779.145886:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139116a000 from 5 10000000:01000000:0.0:1788725779.145891:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788725779.145951:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.145964:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.145985:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.149486:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395584:0@lo:101: 00000100:00100000:0.0:1788725779.149616:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.149684:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.149771:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395584 00000100:00100000:1.0:1788725779.149782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395584 00000100:00100000:1.0:1788725779.149851:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788725779.149863:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791395584:12345-0@lo:101: 00010000:00010000:1.0:1788725779.149884:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725779.149907:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c72 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.149940:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c72 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.149968:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c72 expref: 19 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725779.149977:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b600, rc 0) 00000100:00100000:1.0:1788725779.150008:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791395584:12345-0@lo:101: Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.150025:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788725779.150816:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395584:0@lo:101: 00010000:00010000:0.0:1788725779.150838:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.150851:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.150928:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395712:0@lo:256: 00000100:00100000:0.0:1788725779.150974:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.151019:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.151184:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395712 00000100:00100000:1.0:1788725779.151191:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395712 00000100:00100000:1.0:1788725779.151228:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788725779.151239:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791395712:12345-0@lo:256: 20000000:01000000:1.0:1788725779.151260:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788725779.151282:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788725779.151286:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788725779.151375:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791395712:12345-0@lo:256: Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.151392:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788725779.151412:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395712:0@lo:256: 10000000:01000000:0.0:1788725779.151465:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725779.151473:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.151482:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725779.151492:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788725779.151495:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788725779.151503:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:3.0:1788725779.151798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8433:x1875614791394816:12345-0@lo:700: Request processed in 19706us (24141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725779.151824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788725779.151963:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.151972:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.151985:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.152003:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395840:0@lo:101: 00000100:00100000:0.0:1788725779.152053:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.152081:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788725779.152136:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a04380 x1875614791394816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.152151:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8433:1875614791394816:0@lo:700: 00000100:00100000:3.0:1788725779.152172:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395840 40000000:02000000:0.0:1788725779.152174:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1788725779.152179:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395840 00000100:00100000:3.0:1788725779.152216:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788725779.152229:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791395840:12345-0@lo:101: 00010000:00010000:3.0:1788725779.152241:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725779.152255:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36c80 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.152279:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36c80 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.152289:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c80 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725779.152298:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178800, rc 0) 00000100:00100000:3.0:1788725779.152333:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791395840:12345-0@lo:101: Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725779.152339:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788725779.160576:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395840:0@lo:101: 00010000:00010000:0.0:1788725779.160616:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725779.160633:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.160738:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395968:0@lo:501: 00000100:00100000:0.0:1788725779.160819:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.160876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791395968 00000100:00100000:0.0:1788725779.160879:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.160887:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791395968 00000100:00100000:1.0:1788725779.160955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788725779.160972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791395968:12345-0@lo:501: 00000100:00100000:1.0:1788725779.161386:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791395968:12345-0@lo:501: Request processed in 419us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.161396:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788725779.165845:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791395968:0@lo:501: 00000100:00100000:0.0:1788725779.166555:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791396096:0@lo:503: 00000100:00100000:0.0:1788725779.166669:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.166723:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.166767:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396096 00000100:00100000:0.0:1788725779.166776:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396096 00000100:00100000:0.0:1788725779.166837:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788725779.166849:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791396096:12345-0@lo:503: 00000001:00100000:2.0:1788725779.166897:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788725779.167640:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791396096:12345-0@lo:503: Request processed in 789us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.167651:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788725779.167767:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791394688:12345-0@lo:700: Request processed in 40180us (40354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.167777:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788725779.168345:0:8702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13842af100 x1875614791394688/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725779.168365:0:8702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791394688:0@lo:700: 00000100:00100000:2.0:1788725779.173694:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791396096:0@lo:503: 00000100:00100000:2.0:1788725779.175989:0:8709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8709:1875614791396224:0@lo:502: 00000100:00100000:2.0:1788725779.177720:0:8709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.177788:0:8709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.177974:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396224 00000100:00100000:0.0:1788725779.177987:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396224 00000100:00100000:0.0:1788725779.178062:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788725779.178075:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:8709:x1875614791396224:12345-0@lo:502: 00000100:00100000:0.0:1788725779.178271:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:8709:x1875614791396224:12345-0@lo:502: Request processed in 198us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.178280:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788725779.178916:0:8709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8709:1875614791396224:0@lo:502: 00000020:01000000:2.0:1788725779.178967:0:8709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788725779.178977:0:8709:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788725779.178988:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725779.178991:0:8709:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788725779.178996:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788725779.179001:0:8709:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788725779.179045:0:8709:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788725779.179048:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725779.179082:0:8709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b1282528000) 00000020:00000080:2.0:1788725779.179113:0:8709:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788725779.179355:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788725779.179513:0:8709:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788725779.179521:0:8709:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788725779.179530:0:8709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d36c95 00010000:00080000:2.0:1788725779.179578:0:8709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1282215000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788725779.179868:0:8709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:3.0:1788725779.185218:0:8702:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788725779.185250:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791396352:0@lo:13: 00000100:00100000:3.0:1788725779.185256:0:8702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396480:0@lo:7: 00000100:00100000:3.0:1788725779.186764:0:8702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.186815:0:8702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a9683cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.187359:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396480 00000100:00100000:0.0:1788725779.187371:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396480 00000100:00100000:0.0:1788725779.187450:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725779.187462:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791396480:12345-0@lo:7: 00000100:00100000:2.0:1788725779.188822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.188956:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396352 00000100:00100000:1.0:1788725779.188966:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396352 00000100:00100000:1.0:1788725779.190552:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788725779.190601:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791396352:12345-0@lo:13: 00002000:00000024:1.0:1788725779.190651:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:1.0:1788725779.190747:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791396352:12345-0@lo:13: Request processed in 152us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.190755:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788725779.190833:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a29500 x1875614791396352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725779.190858:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791396352:0@lo:13: 00000040:01000000:2.0:1788725779.193900:0:8709:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788725779.193928:0:8709:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788725779.194306:0:8709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725779.194500:0:8709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725779.194739:0:8709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788725779.194831:0:8709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788725779.195642:0:8712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725779.195648:0:8712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788725779.199381:0:8709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788725779.199511:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788725779.199698:0:8709:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788725779.199735:0:8709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36c9c 00000100:00080000:3.0:1788725779.199750:0:8709:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788725779.199825:0:8709:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b1282215000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725779.199875:0:8709:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1281a29c00 x1875614791396608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00080000:0.0:1788725779.199880:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788725779.199889:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788725779.199948:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791396608:0@lo:8: 00000100:00080000:3.0:1788725779.200006:0:8709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788725779.200229:0:8709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725779.200235:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725779.200237:0:8709:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788725779.200241:0:8709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725779.200245:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725779.200246:0:8709:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788725779.200249:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788725779.200251:0:8709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788725779.200281:0:8709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8709:1875614791396736:0@lo:502: 00000100:00100000:2.0:1788725779.200362:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.200432:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788725779.200440:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788725779.200587:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791396480:12345-0@lo:7: Request processed in 13125us (13826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.200607:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788725779.200667:0:8702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a29880 x1875614791396480/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.200683:0:8702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396480:0@lo:7: 00000004:00080000:0.0:1788725779.200695:0:8702:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788725779.200736:0:8702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396864:0@lo:5: 00000100:00100000:0.0:1788725779.200768:0:8702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.200791:0:8702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.200806:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396608 00000100:00100000:0.0:1788725779.200813:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396608 00000100:00100000:0.0:1788725779.200834:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396864 00000100:00100000:0.0:1788725779.200837:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396864 00000100:00100000:0.0:1788725779.200864:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725779.200884:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1875614791396608:12345-0@lo:8: 00010000:00080000:0.0:1788725779.200915:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788725779.200958:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36ca3 00002000:00100000:0.0:1788725779.200977:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b1281a3d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788725779.200982:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788725779.200987:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788725779.201067:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788725779.201104:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b1281a39000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725779.201199:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791396608:12345-0@lo:8: Request processed in 326us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.201205:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725779.201237:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788725779.201244:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a29c00 x1875614791396608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725779.201261:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791396864:12345-0@lo:5: 00000100:00100000:0.0:1788725779.201276:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788725779.201285:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00002000:00080000:1.0:1788725779.201296:0:8716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00080000:0.0:1788725779.201296:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788725779.201303:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788725779.201307:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282215000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788725779.201321:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788725779.201329:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791396608:0@lo:8: 00000100:00100000:1.0:1788725779.201347:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791396864:12345-0@lo:5: Request processed in 100us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.201355:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1788725779.201360:0:8712:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788725779.201424:0:8712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224357305787ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788725779.201432:0:8712:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:0.0:1788725779.201479:0:8702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a04380 x1875614791396864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.201488:0:8702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396864:0@lo:5: 00000004:00080000:0.0:1788725779.201499:0:8702:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788725779.201528:0:8702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396992:0@lo:5: 00000100:00100000:0.0:1788725779.201558:0:8702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.203776:0:8709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725779.203840:0:8709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a9683b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.205335:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396736 00000100:00100000:2.0:1788725779.205352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396736 00000100:00100000:2.0:1788725779.205491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788725779.205504:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:8709:x1875614791396736:12345-0@lo:502: 00000100:00100000:2.0:1788725779.205785:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:8709:x1875614791396736:12345-0@lo:502: Request processed in 284us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.205794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788725779.205904:0:8709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:8709:1875614791396736:0@lo:502: 00000020:01000000:3.0:1788725779.205950:0:8709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725779.205960:0:8709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725779.205963:0:8709:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788725779.205968:0:8709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788725779.206914:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788725779.206953:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788725779.206972:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.206986:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.207605:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791396992 00000100:00100000:0.0:1788725779.207614:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791396992 00000100:00100000:0.0:1788725779.207669:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725779.207681:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8702:x1875614791396992:12345-0@lo:5: 00002000:00080000:0.0:1788725779.207748:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 10000000:01000000:2.0:1788725779.209060:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788725779.209064:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b13a96d0000 from 1 10000000:01000000:2.0:1788725779.209068:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788725779.209202:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.209213:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.209225:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725779.209256:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791397120:0@lo:101: 00000100:00100000:2.0:1788725779.209348:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.209401:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.210234:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397120 00000100:00100000:2.0:1788725779.210246:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397120 00000100:00100000:2.0:1788725779.210314:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725779.210328:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791397120:12345-0@lo:101: 00010000:00010000:2.0:1788725779.210346:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725779.210364:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36caa expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.210394:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.210407:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.210436:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f600, rc 0) 00000100:00100000:2.0:1788725779.210513:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791397120:12345-0@lo:101: Request processed in 188us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725779.210521:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725779.210837:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791397120:0@lo:101: 00010000:00010000:2.0:1788725779.210860:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.210871:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725779.210963:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791397248:0@lo:501: 00000100:00100000:2.0:1788725779.211003:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.211035:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788725779.211050:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397248 00000100:00100000:2.0:1788725779.211053:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397248 00000100:00100000:2.0:1788725779.211089:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788725779.211188:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791397248:12345-0@lo:501: 00000100:00100000:2.0:1788725779.211300:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791397248:12345-0@lo:501: Request processed in 203us (296us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725779.211308:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788725779.211346:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791397248:0@lo:501: 10000000:01000000:2.0:1788725779.211384:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788725779.211392:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725779.211413:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725779.211704:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8702:x1875614791396992:12345-0@lo:5: Request processed in 4024us (10143us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788725779.211713:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725779.212101:0:8702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7000 going to sleep for 11 seconds 00010000:00080000:0.0:1788725779.212257:0:8702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a04380 x1875614791396992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.212275:0:8702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8702:1875614791396992:0@lo:5: 00000004:00080000:0.0:1788725779.212290:0:8702:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788725779.212330:0:8702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8702:1875614791397376:0@lo:900: 00000100:00100000:0.0:1788725779.212367:0:8702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.212478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397376 00000100:00100000:0.0:1788725779.212483:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397376 00000100:00100000:0.0:1788725779.212519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725779.212528:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8702:x1875614791397376:12345-0@lo:900: 00000100:00100000:0.0:1788725779.212582:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8702:x1875614791397376:12345-0@lo:900: Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.212589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725779.212606:0:8702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7000 going to sleep for 11 seconds 00010000:00080000:0.0:1788725779.212618:0:8702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a05180 x1875614791397376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.212628:0:8702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8702:1875614791397376:0@lo:900: 00000004:00080000:1.0:1788725779.213769:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788725779.215137:0:8713:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788725779.215180:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397632:0@lo:7: 00000100:00100000:1.0:1788725779.215272:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.215309:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725779.215332:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791397504:0@lo:13: 00000100:00100000:1.0:1788725779.215359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725779.215403:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397632 00000100:00100000:1.0:1788725779.215410:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397632 00000100:00100000:0.0:1788725779.215615:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397504 00000100:00100000:0.0:1788725779.215621:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397504 00000100:00100000:1.0:1788725779.215814:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725779.221453:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725779.221472:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791397504:12345-0@lo:13: 00002000:00000024:0.0:1788725779.221507:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1788725779.221621:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791397504:12345-0@lo:13: Request processed in 154us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725779.221628:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788725779.221695:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823db800 x1875614791397504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.221730:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791397504:0@lo:13: 00000100:00100000:1.0:1788725779.222136:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8713:x1875614791397632:12345-0@lo:7: 00000100:00080000:0.0:1788725779.224002:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788725779.228931:0:8716:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788725779.228949:0:8716:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788725779.229096:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8713:x1875614791397632:12345-0@lo:7: Request processed in 13265us (13816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.229108:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788725779.229444:0:8713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823d8e00 x1875614791397632/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725779.229464:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397632:0@lo:7: 00000004:00080000:0.0:1788725779.229484:0:8713:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788725779.229540:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397760:0@lo:5: 00000100:00100000:0.0:1788725779.229599:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725779.229641:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725779.229862:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397760 00000100:00100000:3.0:1788725779.229873:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397760 00000100:00100000:3.0:1788725779.229933:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788725779.229944:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8713:x1875614791397760:12345-0@lo:5: 00002000:00080000:3.0:1788725779.229977:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788725779.229982:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788725779.235776:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788725779.235816:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788725779.235823:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788725779.236069:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8713:x1875614791397760:12345-0@lo:5: Request processed in 6120us (6462us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788725779.236083:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788725779.236545:0:8713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a05180 x1875614791397760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725779.236571:0:8713:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788725779.236581:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397760:0@lo:5: 00000004:00080000:2.0:1788725779.236603:0:8713:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788725779.236690:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397888:0@lo:700: 00000100:00100000:2.0:1788725779.236741:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.236782:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788725779.236912:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791397888 00000100:00100000:0.0:1788725779.236921:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791397888 00000100:00100000:0.0:1788725779.236984:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725779.236997:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8713:x1875614791397888:12345-0@lo:700: 00000100:00100000:1.0:1788725779.249347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8713:x1875614791397888:12345-0@lo:700: Request processed in 12337us (12591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725779.249374:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788725779.249505:0:8713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1282598000 x1875614791397888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725779.249524:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791397888:0@lo:700: 00000004:02000040:2.0:1788725779.251090:0:8713:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788725779.262865:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791398016:0@lo:5: 00000100:00100000:2.0:1788725779.263000:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725779.263086:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725779.263985:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398016 00000100:00100000:3.0:1788725779.263998:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398016 00000100:00100000:3.0:1788725779.264080:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788725779.264108:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8713:x1875614791398016:12345-0@lo:5: 00002000:00080000:3.0:1788725779.282886:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788725779.282914:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788725779.287515:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8713:x1875614791398016:12345-0@lo:5: Request processed in 23410us (24503us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788725779.287535:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788725779.287652:0:8713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1282598000 x1875614791398016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725779.287675:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8713:1875614791398016:0@lo:5: 00000004:00080000:2.0:1788725779.287695:0:8713:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788725779.323294:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725780.349831:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725780.949582:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788725781.374033:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725781.807326:0:8854:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725781.807524:0:8854:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788725782.397621:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725782.651414:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725782.651451:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791398144:0@lo:41: 00000100:00100000:0.0:1788725782.651619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725782.653149:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398144 00000100:00100000:3.0:1788725782.653167:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398144 00000100:00100000:3.0:1788725782.653240:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788725782.653253:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791398144:12345-0@lo:41: 00000004:00000024:3.0:1788725782.653302:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788725782.653790:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791398144:12345-0@lo:41: Request processed in 536us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725782.653800:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788725782.653888:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791398144:0@lo:41: 00000001:00080000:1.0:1788725782.709437:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788725783.420714:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725784.188360:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725784.188394:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791398272:0@lo:41: 00000100:00100000:0.0:1788725784.188487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.192958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398272 00000100:00100000:1.0:1788725784.192980:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398272 00000100:00100000:1.0:1788725784.193272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788725784.193286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791398272:12345-0@lo:41: 00000004:00000024:1.0:1788725784.193338:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788725784.193447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791398272:12345-0@lo:41: Request processed in 164us (4959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.193453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725784.193581:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791398272:0@lo:41: 00010000:00010000:1.0:1788725784.443557:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788725784.678799:0:8955:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788725784.680069:0:8955:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788725784.699583:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791398400:0@lo:400: 00000100:00100000:1.0:1788725784.699650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.699695:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791398912:0@lo:400: 00000100:00100000:1.0:1788725784.699721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.699747:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788725784.699753:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791398528:0@lo:400: 00000100:00100000:1.0:1788725784.699777:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.699797:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791399040:0@lo:400: 00000100:00100000:1.0:1788725784.699840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.699873:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791398784:0@lo:400: 00000100:00100000:1.0:1788725784.699905:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.699927:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791399296:0@lo:400: 00000100:00100000:1.0:1788725784.699988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725784.700257:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791399552:0@lo:13: 00000100:00100000:0.0:1788725784.700406:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725784.700467:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725784.700473:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791399424:0@lo:13: 00000100:00100000:0.0:1788725784.700492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.700625:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788725784.700632:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791398656:0@lo:400: 00000100:00100000:1.0:1788725784.700655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.700666:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791399168:0@lo:400: 00000100:00100000:1.0:1788725784.700697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725784.700727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398400 00000100:00100000:1.0:1788725784.700734:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398400 00000100:00100000:1.0:1788725784.700779:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788725784.700788:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791398400:12345-0@lo:400: 00000100:00100000:1.0:1788725784.700828:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791398400:12345-0@lo:400: Request processed in 41us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.700835:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788725784.700867:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398912 00000100:00100000:1.0:1788725784.700871:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398912 00000100:00100000:1.0:1788725784.700900:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398528 00000100:00100000:1.0:1788725784.700903:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398528 00000100:00100000:1.0:1788725784.700914:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399040 00000100:00100000:1.0:1788725784.700917:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399040 00000100:00100000:1.0:1788725784.700944:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398656 00000100:00100000:1.0:1788725784.700947:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398656 00000100:00100000:1.0:1788725784.700961:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725784.700968:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791398912:12345-0@lo:400: 00000100:00100000:1.0:1788725784.701014:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791398912:12345-0@lo:400: Request processed in 46us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.701027:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725784.701041:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725784.701047:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791398528:12345-0@lo:400: 00000100:00100000:1.0:1788725784.701077:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791398528:12345-0@lo:400: Request processed in 30us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.701082:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725784.701094:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725784.701101:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791399040:12345-0@lo:400: 00000100:00100000:1.0:1788725784.701150:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791399040:12345-0@lo:400: Request processed in 49us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.701155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725784.701166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788725784.701173:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791398656:12345-0@lo:400: 00000100:00100000:1.0:1788725784.701202:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791398656:12345-0@lo:400: Request processed in 30us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.701208:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788725784.701231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791398784 00000100:00100000:1.0:1788725784.701234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791398784 00000100:00100000:1.0:1788725784.701256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788725784.701263:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791398784:12345-0@lo:400: 00000100:00100000:1.0:1788725784.701311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791398784:12345-0@lo:400: Request processed in 48us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725784.701317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788725784.701360:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823da300 x1875614791398656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725784.701386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791398656:0@lo:400: 00000100:00100000:1.0:1788725784.701400:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791398784:0@lo:400: 00010000:00080000:1.0:1788725784.701430:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823dbb80 x1875614791398528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725784.701439:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791398528:0@lo:400: 00010000:00080000:1.0:1788725784.701449:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823dad80 x1875614791399040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725784.701457:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791399040:0@lo:400: 00000100:00100000:1.0:1788725784.701465:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791398400:0@lo:400: 00010000:00080000:1.0:1788725784.701474:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823d9880 x1875614791398912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725784.701482:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791398912:0@lo:400: 00000100:00100000:0.0:1788725784.705463:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399296 00000100:00100000:0.0:1788725784.705477:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399296 00000100:00100000:0.0:1788725784.705542:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399168 00000100:00100000:0.0:1788725784.705547:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399168 00000100:00100000:0.0:1788725784.705577:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725784.705588:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791399296:12345-0@lo:400: 00000100:00100000:0.0:1788725784.705671:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791399296:12345-0@lo:400: Request processed in 85us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725784.705678:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788725784.705696:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788725784.705702:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791399168:12345-0@lo:400: 00000100:00100000:0.0:1788725784.705732:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791399168:12345-0@lo:400: Request processed in 31us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725784.705738:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788725784.705757:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725784.705761:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725784.705764:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725784.705775:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399552 00000100:00100000:0.0:1788725784.705779:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399552 00000100:00100000:0.0:1788725784.705797:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399424 00000100:00100000:0.0:1788725784.705800:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399424 00000100:00100000:0.0:1788725784.705814:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725784.705820:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791399552:12345-0@lo:13: 00002000:00000024:0.0:1788725784.705842:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725784.705893:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791399552:12345-0@lo:13: Request processed in 73us (5487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725784.705900:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725784.705913:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788725784.705921:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791399424:12345-0@lo:13: 00002000:00000024:0.0:1788725784.705941:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725784.705965:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791399424:12345-0@lo:13: Request processed in 46us (5471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725784.705970:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788725784.706009:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a28000 x1875614791399424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725784.706020:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788725784.706042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791399424:0@lo:13: 00010000:00080000:0.0:1788725784.706054:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a05880 x1875614791399552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725784.706061:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788725784.706073:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791399552:0@lo:13: 00010000:00080000:0.0:1788725784.706114:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823d9c00 x1875614791399168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725784.706166:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791399168:0@lo:400: 00010000:00080000:0.0:1788725784.706180:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b12823d8000 x1875614791399296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725784.706188:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791399296:0@lo:400: 00010000:00010000:1.0:1788725785.470303:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788725785.596554:0:9003:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788725785.596572:0:9003:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788725786.492226:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725787.522098:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725787.772238:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725787.772263:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791399680:0@lo:41: 00000100:00100000:3.0:1788725787.772328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725787.772391:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399680 00000100:00100000:3.0:1788725787.772398:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399680 00000100:00100000:3.0:1788725787.772442:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788725787.772451:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791399680:12345-0@lo:41: 00000004:00000024:3.0:1788725787.772492:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788725787.772549:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791399680:12345-0@lo:41: Request processed in 98us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725787.772555:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788725787.772601:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791399680:0@lo:41: 00010000:00010000:1.0:1788725788.539323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725789.307564:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791399808:0@lo:41: 00000100:00100000:3.0:1788725789.307672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725789.307835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399808 00000100:00100000:1.0:1788725789.307847:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399808 00000100:00100000:1.0:1788725789.307915:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788725789.307935:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791399808:12345-0@lo:41: 00000004:00000024:1.0:1788725789.308296:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788725789.308376:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791399808:12345-0@lo:41: Request processed in 451us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725789.308384:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788725789.308676:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791399808:0@lo:41: 00010000:00010000:2.0:1788725789.563338:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725789.819995:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791399936:0@lo:400: 00000100:00100000:2.0:1788725789.821632:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791400192:0@lo:400: 00000100:00100000:2.0:1788725789.821721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725789.821791:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791400704:0@lo:400: 00000100:00100000:2.0:1788725789.821819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725789.821857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788725789.821877:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791400320:0@lo:400: 00000100:00100000:2.0:1788725789.821904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725789.821923:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791400832:0@lo:400: 00000100:00100000:2.0:1788725789.821939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725789.821970:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400192 00000100:00100000:2.0:1788725789.821978:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400192 00000100:00100000:2.0:1788725789.822036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725789.822045:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791400192:12345-0@lo:400: 00000100:00100000:2.0:1788725789.822101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791400192:12345-0@lo:400: Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.822108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788725789.822158:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400704 00000100:00100000:2.0:1788725789.822161:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400704 00000100:00100000:2.0:1788725789.822199:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400832 00000100:00100000:2.0:1788725789.822202:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400832 00000100:00100000:0.0:1788725789.822219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725789.822227:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725789.822234:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791400704:12345-0@lo:400: 00000100:00100000:0.0:1788725789.822257:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791400448:0@lo:400: 00000100:00100000:0.0:1788725789.822284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725789.822303:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791400960:0@lo:13: 00000100:00100000:0.0:1788725789.822327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725789.822359:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788725789.822367:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791400064:0@lo:400: 00000100:00100000:0.0:1788725789.822391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725789.822407:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791400576:0@lo:400: 00000100:00100000:0.0:1788725789.822447:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725789.822457:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791401088:0@lo:13: 00000100:00100000:0.0:1788725789.822485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725789.822547:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400448 00000100:00100000:0.0:1788725789.822551:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400448 00000100:00100000:0.0:1788725789.822577:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400064 00000100:00100000:0.0:1788725789.822580:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400064 00000100:00100000:0.0:1788725789.822590:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400576 00000100:00100000:0.0:1788725789.822592:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400576 00000100:00100000:2.0:1788725789.822976:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791400704:12345-0@lo:400: Request processed in 739us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.822985:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788725789.823006:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725789.823015:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791400832:12345-0@lo:400: 00000100:00100000:2.0:1788725789.823042:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791400832:12345-0@lo:400: Request processed in 29us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.823048:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788725789.823368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400320 00000100:00100000:3.0:1788725789.823375:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400320 00000100:00100000:3.0:1788725789.823416:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725789.823425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791400320:12345-0@lo:400: 00000100:00100000:3.0:1788725789.823480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791400320:12345-0@lo:400: Request processed in 45us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725789.823487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725789.823525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791399936 00000100:00100000:3.0:1788725789.823529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791399936 00000100:00100000:3.0:1788725789.823555:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788725789.823562:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791399936:12345-0@lo:400: 00000100:00100000:3.0:1788725789.823613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791399936:12345-0@lo:400: Request processed in 40us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725789.823620:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788725789.823854:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791400960 00000100:00100000:3.0:1788725789.823859:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791400960 00000100:00100000:3.0:1788725789.823876:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401088 00000100:00100000:3.0:1788725789.823878:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401088 00000100:00100000:3.0:1788725789.823889:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725789.823895:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791400960:12345-0@lo:13: 00002000:00000024:3.0:1788725789.823933:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725789.823969:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791400960:12345-0@lo:13: Request processed in 73us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725789.823975:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788725789.823986:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788725789.823992:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791401088:12345-0@lo:13: 00002000:00000024:3.0:1788725789.824000:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725789.824030:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791401088:12345-0@lo:13: Request processed in 28us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725789.824036:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788725789.824098:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a28700 x1875614791401088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725789.824136:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791401088:0@lo:13: 00000100:00100000:3.0:1788725789.824148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791399936:0@lo:400: 00010000:00080000:3.0:1788725789.824163:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422e300 x1875614791400960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725789.824176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791400960:0@lo:13: 00000100:00100000:2.0:1788725789.824962:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725789.824980:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791400448:12345-0@lo:400: 00000100:00100000:2.0:1788725789.825055:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791400448:12345-0@lo:400: Request processed in 81us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.825062:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725789.825089:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725789.825097:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791400064:12345-0@lo:400: 00000100:00100000:2.0:1788725789.825164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791400064:12345-0@lo:400: Request processed in 67us (2772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.825170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725789.825184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788725789.825192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791400576:12345-0@lo:400: 00000100:00100000:2.0:1788725789.825223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791400576:12345-0@lo:400: Request processed in 33us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725789.825229:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788725789.825343:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791400320:0@lo:400: 00010000:00080000:2.0:1788725789.825359:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422d180 x1875614791400832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725789.825377:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791400832:0@lo:400: 00010000:00080000:2.0:1788725789.825391:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a06680 x1875614791400192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725789.825400:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791400192:0@lo:400: 00010000:00080000:2.0:1788725789.825411:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422ed80 x1875614791400704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725789.825420:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791400704:0@lo:400: 00000100:00080000:2.0:1788725789.825447:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725789.825453:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725789.825456:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725789.825711:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a04380 x1875614791400064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725789.825722:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791400064:0@lo:400: 00010000:00080000:3.0:1788725789.825742:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a05180 x1875614791400576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725789.825751:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791400576:0@lo:400: 00010000:00080000:3.0:1788725789.825776:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a06300 x1875614791400448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725789.825784:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791400448:0@lo:400: 00010000:00010000:1.0:1788725790.589607:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725791.611547:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725792.637540:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725792.891311:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725792.891353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791401216:0@lo:41: 00000100:00100000:3.0:1788725792.891464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725792.891568:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401216 00000100:00100000:3.0:1788725792.891578:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401216 00000100:00100000:3.0:1788725792.891638:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725792.891650:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791401216:12345-0@lo:41: 00000004:00000024:3.0:1788725792.891696:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788725792.891967:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791401216:12345-0@lo:41: Request processed in 318us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725792.891975:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725792.892077:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791401216:0@lo:41: 00010000:00010000:1.0:1788725793.660204:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725794.429950:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791401344:0@lo:41: 00000100:00100000:3.0:1788725794.431388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725794.431933:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401344 00000100:00100000:1.0:1788725794.431946:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401344 00000100:00100000:1.0:1788725794.432024:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725794.432036:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791401344:12345-0@lo:41: 00000004:00000024:1.0:1788725794.432206:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788725794.432284:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791401344:12345-0@lo:41: Request processed in 250us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725794.432293:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788725794.432582:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791401344:0@lo:41: 00010000:00010000:3.0:1788725794.683638:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725794.939549:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791401600:0@lo:400: 00000100:00100000:0.0:1788725794.939674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.939751:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791402112:0@lo:400: 00000100:00100000:0.0:1788725794.939778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.939816:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788725794.939832:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791401472:0@lo:400: 00000100:00100000:0.0:1788725794.939866:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.939889:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791401984:0@lo:400: 00000100:00100000:0.0:1788725794.939914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.939933:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791402496:0@lo:400: 00000100:00100000:0.0:1788725794.939955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.939989:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401600 00000100:00100000:0.0:1788725794.939998:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401600 00000100:00100000:0.0:1788725794.940069:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402112 00000100:00100000:0.0:1788725794.940072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402112 00000100:00100000:0.0:1788725794.940101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788725794.940110:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791401600:12345-0@lo:400: 00000100:00100000:0.0:1788725794.940194:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791401600:12345-0@lo:400: Request processed in 85us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.940202:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788725794.940220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788725794.940227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791402112:12345-0@lo:400: 00000100:00100000:0.0:1788725794.940252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791402112:12345-0@lo:400: Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.940258:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788725794.940278:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401472 00000100:00100000:0.0:1788725794.940282:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401472 00000100:00100000:0.0:1788725794.940308:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788725794.940315:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3639:x1875614791401472:12345-0@lo:400: 00000100:00100000:0.0:1788725794.940344:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3639:x1875614791401472:12345-0@lo:400: Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.940350:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788725794.940385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401984 00000100:00100000:0.0:1788725794.940389:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401984 00000100:00100000:0.0:1788725794.940409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725794.940415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791401984:12345-0@lo:400: 00000100:00100000:0.0:1788725794.940446:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791401984:12345-0@lo:400: Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.940452:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725794.940481:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402496 00000100:00100000:0.0:1788725794.940485:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402496 00000100:00100000:0.0:1788725794.940516:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788725794.940523:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791402496:12345-0@lo:400: 00000100:00100000:0.0:1788725794.940553:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791402496:12345-0@lo:400: Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.940559:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788725794.940578:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725794.940583:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725794.940615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791401472:0@lo:400: 00000100:00100000:0.0:1788725794.940628:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791401984:0@lo:400: 00010000:00080000:0.0:1788725794.940641:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f2680 x1875614791402496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.940652:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791402496:0@lo:400: 00010000:00080000:0.0:1788725794.940663:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f0380 x1875614791401600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.940671:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791401600:0@lo:400: 00010000:00080000:0.0:1788725794.940680:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f3100 x1875614791402112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.940702:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791402112:0@lo:400: 00000100:00100000:2.0:1788725794.941045:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791401728:0@lo:400: 00000100:00100000:2.0:1788725794.941094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725794.941180:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791402240:0@lo:400: 00000100:00100000:2.0:1788725794.941203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725794.941222:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788725794.941229:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791401856:0@lo:400: 00000100:00100000:2.0:1788725794.941250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725794.941266:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791402368:0@lo:400: 00000100:00100000:2.0:1788725794.941288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725794.942203:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402240 00000100:00100000:0.0:1788725794.942215:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402240 00000100:00100000:0.0:1788725794.942286:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401856 00000100:00100000:0.0:1788725794.942289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401856 00000100:00100000:0.0:1788725794.942310:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725794.942321:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791402240:12345-0@lo:400: 00000100:00100000:0.0:1788725794.942402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791402240:12345-0@lo:400: Request processed in 83us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.942410:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725794.942427:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788725794.942434:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791401856:12345-0@lo:400: 00000100:00100000:0.0:1788725794.942502:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791401856:12345-0@lo:400: Request processed in 68us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.942508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788725794.942575:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f3800 x1875614791401856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.942592:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791401856:0@lo:400: 00010000:00080000:0.0:1788725794.942605:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f1180 x1875614791402240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.942614:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791402240:0@lo:400: 00000100:00100000:0.0:1788725794.942958:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402368 00000100:00100000:0.0:1788725794.942963:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402368 00000100:00100000:0.0:1788725794.942999:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788725794.943006:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791402368:12345-0@lo:400: 00000100:00100000:0.0:1788725794.943079:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791402368:12345-0@lo:400: Request processed in 73us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725794.943087:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788725794.943135:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f3480 x1875614791402368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725794.943147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791402368:0@lo:400: 00000100:00080000:2.0:1788725794.943232:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725794.943239:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725794.944777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791401728 00000100:00100000:1.0:1788725794.944794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791401728 00000100:00100000:1.0:1788725794.944855:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725794.944866:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791401728:12345-0@lo:400: 00000100:00100000:1.0:1788725794.944974:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791401728:12345-0@lo:400: Request processed in 110us (3879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725794.944982:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788725794.945096:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791401728:0@lo:400: 00000100:00100000:2.0:1788725794.947939:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791402624:0@lo:13: 00000100:00100000:2.0:1788725794.948055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725794.948187:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402624 00000100:00100000:1.0:1788725794.948197:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402624 00000100:00100000:1.0:1788725794.948255:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788725794.948266:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791402624:12345-0@lo:13: 00002000:00000024:1.0:1788725794.948299:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725794.948350:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791402624:12345-0@lo:13: Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725794.948356:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788725794.949574:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f3b80 x1875614791402624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725794.949605:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791402624:0@lo:13: 00000100:00100000:2.0:1788725794.952961:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791402752:0@lo:13: 00000100:00100000:2.0:1788725794.953079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725794.953232:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402752 00000100:00100000:1.0:1788725794.953246:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402752 00000100:00100000:1.0:1788725794.953313:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788725794.953342:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791402752:12345-0@lo:13: 00002000:00000024:1.0:1788725794.953373:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725794.963214:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791402752:12345-0@lo:13: Request processed in 9858us (10119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725794.963234:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788725794.966229:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e74b480 x1875614791402752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725794.966267:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791402752:0@lo:13: 00010000:00010000:0.0:1788725795.715995:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788725795.977431:0:9502:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788725795.977436:0:9502:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788725795.977438:0:9502:0:(obd_mount.c:940:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788725795.977596:0:9502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b1282214000 00000020:01000004:2.0:1788725795.977615:0:9502:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788725795.977633:0:9502:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788725795.977650:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b12825299b8) 00000020:00000080:2.0:1788725795.977671:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788725796.046277:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788725796.046349:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788725796.064706:0:9502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788725796.065083:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788725796.065101:0:9502:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788725796.065198:0:9502:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13c582691d36cbf 00000020:01000004:3.0:1788725796.065207:0:9502:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788725796.065238:0:9502:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788725796.065248:0:9502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788725796.065256:0:9502:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788725796.065295:0:9502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788725796.065300:0:9502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788725796.084723:0:9502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788725796.084770:0:9502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788725796.084776:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788725796.084778:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725796.084779:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725796.084780:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725796.084782:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725796.084783:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725796.084785:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725796.084786:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725796.084788:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725796.084790:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725796.084791:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788725796.084796:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788725796.084799:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788725796.084800:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725796.084801:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725796.084803:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725796.084804:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725796.084805:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725796.084806:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725796.084807:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725796.084808:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725796.084809:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725796.084811:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788725796.084857:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788725796.084883:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791402880:0@lo:253: 00000100:00100000:3.0:1788725796.085045:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725796.085236:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791402880 00000100:00100000:1.0:1788725796.085247:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791402880 00000100:00100000:3.0:1788725796.085305:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725796.085332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788725796.085345:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:9502:x1875614791402880:12345-0@lo:253: 20000000:01000000:1.0:1788725796.085393:0:6506:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788725796.085399:0:6506:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788725796.085405:0:6506:0:(mgs_llog.c:872:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788725796.085410:0:6506:0:(mgs_llog.c:3865:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788725796.086200:0:6506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788725796.086743:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788725796.086765:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788725796.086788:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788725796.086795:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788725796.086807:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788725796.086821:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788725796.086958:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788725796.086976:0:6506:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788725796.086978:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788725796.086994:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788725796.087002:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788725796.087017:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788725796.087024:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788725796.087039:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788725796.087048:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788725796.087619:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788725796.087657:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788725796.087764:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788725796.087778:0:6506:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788725796.087779:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788725796.087795:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788725796.087801:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788725796.087814:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788725796.087819:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788725796.087833:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788725796.087839:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788725796.087851:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788725796.087866:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788725796.089825:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788725796.089857:0:6506:0:(mgs_llog.c:3818:mgs_write_log_osc_to_lov()) add nid 192.168.203.112@tcp 20000000:01000000:1.0:1788725796.089860:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg (null) 0xcf005 192.168.203.112@tcp (null) (null) (null) 00000040:00080000:1.0:1788725796.089877:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788725796.089886:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788725796.089901:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788725796.089907:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.112@tcp (null) (null) 00000040:00080000:1.0:1788725796.089920:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788725796.089928:0:6506:0:(mgs_llog.c:1542:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788725796.089942:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788725796.089959:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788725796.089977:0:6506:0:(mgs_llog.c:5255:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788725796.089980:0:6506:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788725796.089984:0:6506:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788725796.090081:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788725796.090084:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788725796.097327:0:9509:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788725796.097410:0:9509:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788725796.097430:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788725796.097949:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788725796.097979:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788725796.097996:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788725796.098014:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788725796.098018:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788725796.099298:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788725796.099698:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788725796.099732:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788725796.099748:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1788725796.099760:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788725796.099763:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725796.102516:0:9511:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725796.102592:0:9511:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725796.102608:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788725796.104731:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788725796.104788:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788725796.104814:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788725796.104834:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788725796.104838:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725796.106830:0:9512:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725796.106891:0:9512:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725796.106909:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788725796.107201:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788725796.107230:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788725796.107245:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788725796.107261:0:6506:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788725796.107264:0:6506:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788725796.108265:0:9513:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788725796.108332:0:9513:0:(mgs_llog.c:1079:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788725796.108346:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788725796.108772:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788725796.108799:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788725796.108815:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:0.0:1788725796.108838:0:6506:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788725796.108876:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108899:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108909:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bdf expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108917:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c1e expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108925:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c3a expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108933:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c64 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108940:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c80 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108947:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.108955:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.109010:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.109032:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.109221:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403008:0@lo:104: 00000100:00100000:0.0:1788725796.109475:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725796.109588:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.109598:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.109607:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403136:0@lo:104: 00000100:00100000:0.0:1788725796.109630:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725796.109828:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.109837:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.109847:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403264:0@lo:104: 00000100:00100000:0.0:1788725796.109872:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.109918:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403008 00000100:00100000:2.0:1788725796.109937:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403008 00000100:00100000:2.0:1788725796.109981:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403136 00000100:00100000:2.0:1788725796.109984:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403136 00000100:00100000:2.0:1788725796.110000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788725796.110010:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791403008:12345-0@lo:104: 00010000:00010000:2.0:1788725796.110026:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.110105:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725796.110112:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791403008:12345-0@lo:104: Request processed in 103us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.110163:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788725796.110184:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788725796.110191:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791403136:12345-0@lo:104: 00010000:00010000:2.0:1788725796.110199:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.110232:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788725796.110238:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791403136:12345-0@lo:104: Request processed in 48us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.110244:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788725796.110396:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725796.110406:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110424:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.110429:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110438:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.110455:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.110462:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.110505:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110513:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.110537:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110544:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36caa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cb1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110560:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725796.110564:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110569:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6ae000 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.110572:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110589:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.110595:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.110601:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.110616:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110622:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.110638:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110645:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae000/0xa13c582691d36c80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c87 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110655:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.110657:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.110658:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.110665:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725796.110678:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791403392:0@lo:103: 00000100:00100000:3.0:1788725796.110716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.110772:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791403520:0@lo:103: 00000100:00100000:3.0:1788725796.110797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.110833:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403392 00000100:00100000:3.0:1788725796.110838:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403392 00010000:00010000:3.0:1788725796.110862:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 22 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.110898:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403520 00000100:00100000:3.0:1788725796.110901:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403520 00010000:00010000:3.0:1788725796.110914:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 23 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.110927:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725796.110935:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3641:x1875614791403392:12345-0@lo:103: 00010000:00010000:3.0:1788725796.110947:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.110953:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 23 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110965:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 23 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.110984:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.111016:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3641:x1875614791403392:12345-0@lo:103: Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.111023:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725796.111038:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725796.111045:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3638:x1875614791403520:12345-0@lo:103: 00010000:00010000:3.0:1788725796.111051:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.111071:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 22 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.111080:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 22 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.111089:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.111157:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3638:x1875614791403520:12345-0@lo:103: Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.111164:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788725796.111208:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791403520:0@lo:103: 00000100:00100000:3.0:1788725796.111235:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791403392:0@lo:103: 00010000:00010000:0.0:1788725796.111649:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.111663:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 21 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.111674:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403648:0@lo:104: 00000100:00100000:0.0:1788725796.111703:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725796.111977:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.112001:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.112012:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403776:0@lo:104: 00000100:00100000:0.0:1788725796.112038:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725796.112076:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403264 00000100:00100000:1.0:1788725796.112082:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403264 00000100:00100000:1.0:1788725796.112141:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403648 00000100:00100000:1.0:1788725796.112145:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403648 00000100:00100000:1.0:1788725796.112161:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788725796.112170:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791403264:12345-0@lo:104: 00010000:00010000:1.0:1788725796.112182:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.112236:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725796.112242:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791403264:12345-0@lo:104: Request processed in 73us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.112249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788725796.112266:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725796.112272:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791403648:12345-0@lo:104: 00010000:00010000:1.0:1788725796.112279:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.112307:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725796.112321:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791403648:12345-0@lo:104: Request processed in 50us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.112326:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788725796.112566:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725796.112573:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112581:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afc00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.112585:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112594:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.112602:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.112608:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.112646:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112654:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.112672:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112679:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112703:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725796.112707:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112713:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ae00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.112715:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112723:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.112729:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.112735:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.112750:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112756:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.112771:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112778:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c41 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.112788:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.112790:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.112792:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725796.112806:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791403904:0@lo:103: 00000100:00100000:3.0:1788725796.112849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.112886:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791404032:0@lo:103: 00000100:00100000:3.0:1788725796.112911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.112939:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403904 00000100:00100000:3.0:1788725796.112943:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403904 00010000:00010000:3.0:1788725796.112961:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 22 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.112981:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404032 00000100:00100000:3.0:1788725796.112983:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404032 00010000:00010000:3.0:1788725796.112993:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 23 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.113005:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725796.113012:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3639:x1875614791403904:12345-0@lo:103: 00010000:00010000:3.0:1788725796.113021:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.113026:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 23 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.113043:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 23 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.113198:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.113238:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3639:x1875614791403904:12345-0@lo:103: Request processed in 226us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.113246:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788725796.113262:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725796.113270:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3640:x1875614791404032:12345-0@lo:103: 00010000:00010000:3.0:1788725796.113277:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.113288:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 22 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.113297:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 22 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.113423:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.113463:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3640:x1875614791404032:12345-0@lo:103: Request processed in 193us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.113470:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788725796.113536:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791404032:0@lo:103: 00010000:00010000:3.0:1788725796.113564:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725796.113618:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791403904:0@lo:103: 00010000:00010000:0.0:1788725796.113723:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.113736:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113747:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791404160:0@lo:104: 00000100:00100000:0.0:1788725796.113777:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725796.113795:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.113803:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 21 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113811:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791404288:0@lo:104: 00000100:00100000:0.0:1788725796.113830:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb600 going to sleep for 11 seconds 00010000:00010000:0.0:1788725796.113859:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f600/0xa13c582691d36cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36caa expref: 21 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113871:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403008:0@lo:104: 00010000:00010000:0.0:1788725796.113883:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178800/0xa13c582691d36c87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c80 expref: 20 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113906:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403136:0@lo:104: 00010000:00010000:0.0:1788725796.113920:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af600/0xa13c582691d36c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c64 expref: 19 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113927:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403264:0@lo:104: 00010000:00010000:0.0:1788725796.113937:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178600/0xa13c582691d36c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c3a expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.113944:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403648:0@lo:104: 00000100:00100000:1.0:1788725796.114008:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788725796.114026:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725796.114037:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791403776 00000100:00100000:1.0:1788725796.114041:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791403776 00000100:00100000:1.0:1788725796.114078:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404160 00000100:00100000:1.0:1788725796.114082:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404160 00000100:00100000:1.0:1788725796.114105:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404288 00000100:00100000:1.0:1788725796.114108:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404288 00000100:00100000:1.0:1788725796.114156:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725796.114165:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6506:x1875614791403776:12345-0@lo:104: 00010000:00010000:1.0:1788725796.114176:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.114227:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725796.114233:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:6506:x1875614791403776:12345-0@lo:104: Request processed in 70us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.114239:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725796.114253:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725796.114259:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791404160:12345-0@lo:104: 00010000:00010000:1.0:1788725796.114267:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.114331:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725796.114337:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6506:x1875614791404160:12345-0@lo:104: Request processed in 78us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.114343:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788725796.114560:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788725796.114569:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791404288:12345-0@lo:104: 00010000:00010000:1.0:1788725796.114577:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.114609:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788725796.114614:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6506:x1875614791404288:12345-0@lo:104: Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.114630:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788725796.114937:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788725796.114945:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.114953:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.114957:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.114967:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.114975:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.114981:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.115021:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115028:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.115065:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115074:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c25 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115088:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725796.115092:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115098:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.115101:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115107:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.115133:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.115139:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.115153:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115159:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.115175:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115182:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36be6 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115192:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725796.115201:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115208:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.115211:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115218:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.115224:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.115230:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.115244:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115250:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.115256:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115262:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bbc expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115277:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.115279:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.115281:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725796.115290:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725796.115304:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791404416:0@lo:103: 00000100:00100000:3.0:1788725796.115533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.115575:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791404544:0@lo:103: 00000100:00100000:3.0:1788725796.115609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.115628:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725796.115634:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791404672:0@lo:103: 00000100:00100000:3.0:1788725796.115656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.115682:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404416 00000100:00100000:3.0:1788725796.115689:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404416 00010000:00010000:3.0:1788725796.115719:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 18 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.115738:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404544 00000100:00100000:3.0:1788725796.115741:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404544 00010000:00010000:3.0:1788725796.115751:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 19 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.115761:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404672 00000100:00100000:3.0:1788725796.115763:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404672 00010000:00010000:3.0:1788725796.115772:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 20 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.115785:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788725796.115794:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791404416:12345-0@lo:103: 00010000:00010000:3.0:1788725796.115805:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.115811:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 20 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115823:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 20 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115841:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.115874:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791404416:12345-0@lo:103: Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.115890:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788725796.115907:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788725796.115912:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3638:x1875614791404544:12345-0@lo:103: 00010000:00010000:3.0:1788725796.115919:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.115923:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 19 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115931:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 19 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.115940:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.115963:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3638:x1875614791404544:12345-0@lo:103: Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.115969:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788725796.115978:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725796.115983:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3638:x1875614791404672:12345-0@lo:103: 00010000:00010000:3.0:1788725796.115990:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725796.115995:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.116003:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.116016:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.116024:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.116050:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.116216:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c1e expref: 18 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.116230:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791403776:0@lo:104: 00010000:00010000:0.0:1788725796.116243:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36bdf expref: 17 pid: 6504 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.116252:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791404160:0@lo:104: 00010000:00010000:0.0:1788725796.116262:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36bb5 expref: 16 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.116269:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6506:1875614791404288:0@lo:104: 00010000:00010000:0.0:1788725796.116306:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.116438:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.116466:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725796.116477:0:6506:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788725796.117509:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117519:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117527:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117534:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6ae400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725796.117539:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117549:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117564:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117573:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36cc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.117596:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725796.117669:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3638:x1875614791404672:12345-0@lo:103: Request processed in 1682us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.117678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788725796.117750:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791404672:0@lo:103: 00000100:00100000:3.0:1788725796.117775:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791404544:0@lo:103: 00000100:00100000:3.0:1788725796.117810:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791404416:0@lo:103: 00010000:00010000:3.0:1788725796.117828:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.117835:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725796.120198:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:9502:x1875614791402880:12345-0@lo:253: Request processed in 34841us (35138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.120217:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788725796.120543:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791402880:0@lo:253: 10000000:01000000:3.0:1788725796.120562:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788725796.120566:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788725796.120568:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725796.120569:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725796.120571:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788725796.120572:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725796.120573:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725796.120575:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725796.120577:0:9502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788725796.120579:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725796.120581:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788725796.120611:0:9502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b1282214000 from lustre-OST0001 10000000:01000000:3.0:1788725796.120647:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788725796.120651:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788725796.120663:0:9502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b13a96d0000 local copy 10000000:01000000:3.0:1788725796.120667:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788725796.120712:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.120724:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.120735:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.120756:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791404800:0@lo:101: 00000100:00100000:3.0:1788725796.120818:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.120872:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e5923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.120993:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404800 00000100:00100000:0.0:1788725796.121002:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404800 00000100:00100000:0.0:1788725796.121067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788725796.121080:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+14:9502:x1875614791404800:12345-0@lo:101: 00010000:00010000:0.0:1788725796.121094:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725796.121109:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ccd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.121167:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ccd expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.121180:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ccd expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.121190:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6aec00, rc 0) 00000100:00100000:0.0:1788725796.121231:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791404800:12345-0@lo:101: Request processed in 155us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.121239:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788725796.121485:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791404800:0@lo:101: 00010000:00010000:3.0:1788725796.121500:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.121510:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.121626:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791404928:0@lo:501: 00000100:00100000:3.0:1788725796.121678:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.121708:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e5923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.121816:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791404928 00000100:00100000:0.0:1788725796.121820:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791404928 00000100:00100000:0.0:1788725796.121858:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788725796.121867:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791404928:12345-0@lo:501: 00000100:00100000:0.0:1788725796.121933:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791404928:12345-0@lo:501: Request processed in 67us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725796.121952:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788725796.122034:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791404928:0@lo:501: 10000000:01000000:3.0:1788725796.122050:0:9502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788725796.122082:0:9502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788725796.122088:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.122098:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.122105:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.122149:0:9502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788725796.122179:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b1282214000 10000000:01000000:3.0:1788725796.122185:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788725796.122191:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788725796.122202:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788725796.122207:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788725796.122210:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788725796.122230:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.122237:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.122245:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.122257:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405056:0@lo:101: 00000100:00100000:3.0:1788725796.122283:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.122296:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725796.122532:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405056 00000100:00100000:1.0:1788725796.122537:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405056 00000100:00100000:1.0:1788725796.122576:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725796.122584:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405056:12345-0@lo:101: 00010000:00010000:1.0:1788725796.122593:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725796.122605:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36cdb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.122625:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.122635:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.122643:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148bc00, rc 0) 00000100:00100000:1.0:1788725796.122676:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791405056:12345-0@lo:101: Request processed in 93us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.122683:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:0.0:1788725796.122804:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725796.122811:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.122819:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725796.122824:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.122833:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725796.122841:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725796.122847:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788725796.122869:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.122875:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725796.122907:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.122914:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179600/0xa13c582691d36ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa13c582691d36cd4 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.122928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725796.122930:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725796.122932:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725796.122941:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725796.122960:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791405184:0@lo:103: 00000100:00100000:0.0:1788725796.123007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725796.123041:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405184 00000100:00100000:0.0:1788725796.123045:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405184 00000100:00100000:0.0:1788725796.123086:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725796.123093:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3641:x1875614791405184:12345-0@lo:103: 00010000:00010000:0.0:1788725796.123102:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725796.123137:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36ccd expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.123148:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725796.123175:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3641:x1875614791405184:12345-0@lo:103: Request processed in 83us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.123181:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788725796.123213:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791405184:0@lo:103: 00000100:00100000:3.0:1788725796.123497:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405056:0@lo:101: 00010000:00010000:3.0:1788725796.123510:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.123519:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725796.123602:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405312:0@lo:501: 00000100:00100000:3.0:1788725796.123631:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.123654:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.123746:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405312 00000100:00100000:0.0:1788725796.123751:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405312 00000100:00100000:0.0:1788725796.123783:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788725796.123790:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405312:12345-0@lo:501: 00000100:00100000:0.0:1788725796.123911:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405312:12345-0@lo:501: Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.123917:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788725796.124016:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405312:0@lo:501: 00000100:00100000:3.0:1788725796.124044:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405440:0@lo:503: 00000100:00100000:3.0:1788725796.124101:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.124149:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.124496:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405440 00000100:00100000:0.0:1788725796.124501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405440 00000100:00100000:0.0:1788725796.124535:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788725796.124543:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405440:12345-0@lo:503: 00000100:00100000:0.0:1788725796.124641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405440:12345-0@lo:503: Request processed in 97us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.124655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788725796.124753:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405440:0@lo:503: 00000040:00080000:3.0:1788725796.125280:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788725796.126249:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405568:0@lo:502: 00000100:00100000:3.0:1788725796.126348:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.126659:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.126780:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405568 00000100:00100000:0.0:1788725796.126790:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405568 00000100:00100000:0.0:1788725796.126857:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788725796.126869:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405568:12345-0@lo:502: 00000100:00100000:0.0:1788725796.127023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405568:12345-0@lo:502: Request processed in 155us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.127030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788725796.127163:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405568:0@lo:502: 00000040:00080000:2.0:1788725796.127504:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788725796.127538:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788725796.127554:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788725796.127567:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788725796.127581:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788725796.127594:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788725796.127625:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405696:0@lo:502: 00000100:00100000:2.0:1788725796.127680:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.127714:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138643ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725796.127906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405696 00000100:00100000:3.0:1788725796.127912:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405696 00000100:00100000:3.0:1788725796.127961:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788725796.127971:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405696:12345-0@lo:502: 00000100:00100000:3.0:1788725796.128074:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405696:12345-0@lo:502: Request processed in 104us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.128082:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788725796.128495:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405696:0@lo:502: 00000040:00080000:2.0:1788725796.128556:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788725796.128567:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788725796.129522:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788725796.129534:0:9514:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788725796.129542:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725796.129545:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788725796.129552:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725796.129572:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b128252b370) 00000020:00000080:2.0:1788725796.129620:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788725796.129629:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788725796.129717:0:9514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1282214000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788725796.129727:0:9514:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788725796.129734:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13c582691d36cf0 00010000:00010000:2.0:1788725796.137703:0:9514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788725796.138586:0:9514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788725796.142343:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788725796.143283:0:9514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788725796.149802:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788725796.150179:0:9514:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788725796.157793:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788725796.161678:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788725796.161702:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725796.161710:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725796.161712:0:9514:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788725796.161716:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725796.161721:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725796.161722:0:9514:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788725796.161725:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788725796.161727:0:9514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788725796.161760:0:9514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725796.161763:0:9514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725796.161764:0:9514:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788725796.161767:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788725796.166044:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788725796.166527:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788725796.166619:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.166635:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725796.167655:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1282214000 from 1 10000000:01000000:2.0:1788725796.167666:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725796.167727:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.167739:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.167752:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.167784:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405824:0@lo:101: 00000100:00100000:2.0:1788725796.167874:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.167938:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12820646c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725796.168410:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405824 00000100:00100000:1.0:1788725796.168421:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405824 00000100:00100000:1.0:1788725796.168494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788725796.168505:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:9502:x1875614791405824:12345-0@lo:101: 00010000:00010000:1.0:1788725796.168526:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725796.168544:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36cf7 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.168598:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.168610:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.168621:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ac00, rc 0) 00000100:00100000:1.0:1788725796.168802:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791405824:12345-0@lo:101: Request processed in 296us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.168810:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788725796.169520:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405824:0@lo:101: 00010000:00010000:2.0:1788725796.169546:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.169558:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.169719:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405952:0@lo:501: 00000100:00100000:2.0:1788725796.169765:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.169805:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791405952 00000100:00100000:2.0:1788725796.169811:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791405952 00000100:00100000:2.0:1788725796.169856:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788725796.169867:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791405952:12345-0@lo:501: 00000100:00100000:2.0:1788725796.170163:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791405952:12345-0@lo:501: Request processed in 296us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.170170:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788725796.170216:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12820646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725796.170232:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791405952:0@lo:501: 00000100:00100000:2.0:1788725796.170261:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406080:0@lo:503: 00000100:00100000:2.0:1788725796.170302:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.170338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406080 00000100:00100000:2.0:1788725796.170342:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406080 00000100:00100000:2.0:1788725796.171182:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788725796.171198:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406080:12345-0@lo:503: 00000100:00100000:2.0:1788725796.171324:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406080:12345-0@lo:503: Request processed in 130us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.171332:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788725796.171565:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12820646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725796.171589:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406080:0@lo:503: 00000040:00080000:2.0:1788725796.171891:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788725796.172676:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406208:0@lo:502: 00000100:00100000:2.0:1788725796.172751:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.172798:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12820646c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725796.173161:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406208 00000100:00100000:3.0:1788725796.173170:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406208 00000100:00100000:3.0:1788725796.173235:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788725796.173248:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406208:12345-0@lo:502: 00000100:00100000:3.0:1788725796.174288:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406208:12345-0@lo:502: Request processed in 1035us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.174301:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788725796.174612:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406208:0@lo:502: 00000040:00080000:2.0:1788725796.174889:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788725796.174925:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788725796.174962:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406336:0@lo:502: 00000100:00100000:3.0:1788725796.176617:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.176680:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12820646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725796.176756:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406336 00000100:00100000:2.0:1788725796.176778:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406336 00000100:00100000:2.0:1788725796.176848:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788725796.176860:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406336:12345-0@lo:502: 00000100:00100000:2.0:1788725796.178239:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406336:12345-0@lo:502: Request processed in 1369us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.178254:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788725796.178426:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406336:0@lo:502: 00000040:00080000:3.0:1788725796.178562:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788725796.178582:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788725796.180557:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725796.180574:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725796.180577:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788725796.180585:0:9518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1282214000 00000020:00000080:3.0:1788725796.180588:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788725796.180604:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725796.180607:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725796.180608:0:9518:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788725796.180611:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788725796.180885:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788725796.180922:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725796.180948:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.180962:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725796.181179:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788725796.181182:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b1282214000 10000000:01000000:2.0:1788725796.181186:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b1282214000 10000000:01000000:2.0:1788725796.181191:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788725796.181198:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b1282214000 from 1 10000000:01000000:2.0:1788725796.181202:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725796.181250:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.181260:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.181272:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.181300:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406464:0@lo:101: 00000100:00100000:2.0:1788725796.181708:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.181771:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282064780 going to sleep for 11 seconds 00000100:00100000:3.0:1788725796.181839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406464 00000100:00100000:3.0:1788725796.181849:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406464 00000100:00100000:3.0:1788725796.181946:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788725796.181958:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9502:x1875614791406464:12345-0@lo:101: 00010000:00010000:3.0:1788725796.181975:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725796.182240:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d05 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.182270:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d05 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.182283:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d05 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.182317:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178a00, rc 0) 00000100:00100000:3.0:1788725796.182576:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406464:12345-0@lo:101: Request processed in 619us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.182584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788725796.182678:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406464:0@lo:101: 00010000:00010000:2.0:1788725796.182697:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.182707:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.182844:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406592:0@lo:501: 00000100:00100000:2.0:1788725796.182877:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.182956:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282064780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.183049:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406592 00000100:00100000:0.0:1788725796.183227:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406592 00000100:00100000:0.0:1788725796.183305:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788725796.183324:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406592:12345-0@lo:501: 00000100:00100000:0.0:1788725796.183481:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406592:12345-0@lo:501: Request processed in 158us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.183489:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788725796.183561:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406592:0@lo:501: 00000100:00100000:3.0:1788725796.183597:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406720:0@lo:503: 00000100:00100000:3.0:1788725796.183642:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.183923:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725796.184003:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406720 00000100:00100000:1.0:1788725796.184009:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406720 00000100:00100000:1.0:1788725796.184039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788725796.184048:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406720:12345-0@lo:503: 00000100:00100000:1.0:1788725796.184195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406720:12345-0@lo:503: Request processed in 147us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.184203:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788725796.184508:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406720:0@lo:503: 00000040:00080000:3.0:1788725796.184821:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788725796.184908:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406848:0@lo:502: 00000100:00100000:3.0:1788725796.184960:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.185003:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725796.185207:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406848 00000100:00100000:0.0:1788725796.185213:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406848 00000100:00100000:0.0:1788725796.185253:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788725796.185263:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406848:12345-0@lo:502: 00000100:00100000:0.0:1788725796.185523:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406848:12345-0@lo:502: Request processed in 259us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.185532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788725796.185918:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406848:0@lo:502: 00000040:00080000:3.0:1788725796.186255:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788725796.186289:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788725796.186305:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788725796.186573:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788725796.186591:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788725796.186604:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788725796.186618:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788725796.186632:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788725796.186648:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788725796.186661:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788725796.186673:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788725796.186686:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788725796.186713:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788725796.186727:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788725796.186740:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788725796.186754:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788725796.186767:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788725796.186780:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788725796.186793:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788725796.186806:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788725796.186821:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788725796.186833:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788725796.186846:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788725796.186863:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788725796.186877:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788725796.186892:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788725796.186906:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788725796.186921:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788725796.186937:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788725796.186954:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788725796.186971:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788725796.187511:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788725796.187530:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788725796.187548:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788725796.187564:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788725796.187603:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788725796.187620:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788725796.187634:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788725796.187648:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788725796.187662:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788725796.187675:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788725796.187688:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788725796.187703:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788725796.187719:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788725796.187733:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788725796.187762:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788725796.187822:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406976:0@lo:502: 00000100:00100000:3.0:1788725796.187913:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.188030:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725796.188196:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791406976 00000100:00100000:2.0:1788725796.188206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791406976 00000100:00100000:0.0:1788725796.188788:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788725796.188805:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406976:12345-0@lo:502: 00000100:00100000:0.0:1788725796.189076:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791406976:12345-0@lo:502: Request processed in 276us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.189095:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788725796.189759:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791406976:0@lo:502: 00000040:00080000:3.0:1788725796.189854:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788725796.189870:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788725796.190907:0:9519:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788725796.190930:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b13bd498000) 00000020:00000080:1.0:1788725796.190962:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788725796.194612:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1282214000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788725796.194625:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1282214000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788725796.194628:0:9519:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1282214000 3 00010000:00080000:1.0:1788725796.194673:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b139e739000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788725796.197872:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788725796.199516:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788725796.199578:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788725796.199604:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa13c582691d36d1a 00000100:00080000:1.0:1788725796.199618:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788725796.199625:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b139e739000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788725796.199674:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b139e7f1500 x1875614791407104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725796.199769:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791407104:0@lo:38: 00000100:00100000:2.0:1788725796.199863:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.199973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407104 00000100:00100000:3.0:1788725796.199993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407104 00000100:00100000:3.0:1788725796.200038:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788725796.200048:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875614791407104:12345-0@lo:38: 00010000:00080000:3.0:1788725796.200088:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1788725796.200155:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa13c582691d36d21 00000004:00100000:3.0:1788725796.200176:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788725796.200218:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9b1282103000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788725796.202217:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788725796.202640:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875614791407104:12345-0@lo:38: Request processed in 2584us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.202656:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788725796.202788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791407232:0@lo:400: 00000100:00100000:1.0:1788725796.202863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788725796.203005:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e7f1500 x1875614791407104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725796.203019:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788725796.203033:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788725796.203044:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788725796.203050:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:0.0:1788725796.203213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407232 00000100:00100000:0.0:1788725796.203222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407232 00000100:00100000:0.0:1788725796.203276:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725796.203287:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791407232:12345-0@lo:400: 00000100:00080000:2.0:1788725796.203383:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788725796.203393:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791407104:0@lo:38: 00000100:00100000:2.0:1788725796.203675:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791407616:0@lo:400: 00000100:00100000:2.0:1788725796.203716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.203777:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407616 00000100:00100000:2.0:1788725796.203782:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407616 00000100:00100000:2.0:1788725796.203816:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725796.203824:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791407616:12345-0@lo:400: 00000100:00100000:2.0:1788725796.203867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791407616:12345-0@lo:400: Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.203873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725796.203909:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791407616:0@lo:400: 00000100:00100000:3.0:1788725796.205218:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791407360:0@lo:400: 00000100:00100000:3.0:1788725796.205289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205338:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791407872:0@lo:400: 00000100:00100000:3.0:1788725796.205510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205538:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788725796.205546:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791407488:0@lo:400: 00000100:00100000:3.0:1788725796.205572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205584:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791408000:0@lo:400: 00000100:00100000:3.0:1788725796.205641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205680:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791408128:0@lo:400: 00000100:00100000:3.0:1788725796.205703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205723:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725796.205729:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791407744:0@lo:400: 00000100:00100000:3.0:1788725796.205751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.205777:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407360 00000100:00100000:3.0:1788725796.205785:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407360 00000100:00100000:3.0:1788725796.205840:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788725796.205851:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791407360:12345-0@lo:400: 00000100:00100000:3.0:1788725796.205911:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791407360:12345-0@lo:400: Request processed in 61us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.205919:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788725796.205947:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788725796.205957:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788725796.205971:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408000 00000100:00100000:3.0:1788725796.206454:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408000 00000100:00100000:3.0:1788725796.206506:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408128 00000100:00100000:3.0:1788725796.206510:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408128 00000100:00100000:3.0:1788725796.206535:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788725796.206543:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791408000:12345-0@lo:400: 00000100:00100000:3.0:1788725796.206592:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791408000:12345-0@lo:400: Request processed in 50us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.206599:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788725796.206611:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788725796.206618:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791408128:12345-0@lo:400: 00000100:00100000:0.0:1788725796.206618:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791407232:12345-0@lo:400: Request processed in 3331us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.206627:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788725796.206650:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791408128:12345-0@lo:400: Request processed in 32us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.206664:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788725796.206717:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a2b100 x1875614791408000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.206735:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791408000:0@lo:400: 00000100:00100000:3.0:1788725796.206749:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791407360:0@lo:400: 00000100:00100000:0.0:1788725796.206765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407872 00000100:00100000:0.0:1788725796.206769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407872 00000100:00080000:3.0:1788725796.206780:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725796.206786:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725796.206789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407488 00000100:00100000:0.0:1788725796.206791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407488 00000100:00100000:0.0:1788725796.206804:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791407744 00000100:00100000:0.0:1788725796.206807:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791407744 00010000:00080000:3.0:1788725796.206808:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a29880 x1875614791408128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.206819:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791408128:0@lo:400: 00000100:00100000:0.0:1788725796.206825:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788725796.206831:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725796.206831:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791407872:12345-0@lo:400: 00000100:00100000:0.0:1788725796.206888:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791407872:12345-0@lo:400: Request processed in 57us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.206894:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725796.206905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725796.206911:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791407488:12345-0@lo:400: 00000100:00100000:0.0:1788725796.206939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791407488:12345-0@lo:400: Request processed in 28us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.206944:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725796.206954:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788725796.206960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791407744:12345-0@lo:400: 00000100:00100000:0.0:1788725796.206988:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791407744:12345-0@lo:400: Request processed in 28us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.207001:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788725796.207502:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a2bb80 x1875614791407488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.207514:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791407488:0@lo:400: 00010000:00080000:3.0:1788725796.207525:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a28380 x1875614791407872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.207533:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791407872:0@lo:400: 00010000:00080000:3.0:1788725796.207562:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a2b800 x1875614791407744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.207571:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791407744:0@lo:400: 00000100:00100000:3.0:1788725796.207823:0:9521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875614791408256:0@lo:901: 00000020:01000004:0.0:1788725796.207845:0:9519:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788725796.207863:0:9519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b13be9a8000) 00000100:00100000:3.0:1788725796.207870:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788725796.207887:0:9519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:3.0:1788725796.207900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408256 00000100:00100000:3.0:1788725796.207911:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408256 00000100:00100000:3.0:1788725796.207951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788725796.207959:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875614791408256:12345-0@lo:901: 00000020:01000004:0.0:1788725796.207973:0:9519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1282214000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788725796.207978:0:9519:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1282214000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788725796.207980:0:9519:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1282214000 3 00010000:00080000:0.0:1788725796.208016:0:9519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13af852000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00080000:1.0:1788725796.208480:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1281a2a300 x1875614791407232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725796.208493:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791407232:0@lo:400: 00000100:00100000:3.0:1788725796.208648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9521:x1875614791408256:12345-0@lo:901: Request processed in 686us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725796.208655:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788725796.208679:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725796.208697:0:9521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e5920c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788725796.208712:0:9521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b138422d180 x1875614791408256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788725812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725796.208722:0:9521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9521:1875614791408256:0@lo:901: 00010000:00010000:0.0:1788725796.214557:0:9519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788725796.215288:0:9519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788725796.215788:0:9519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788725796.215805:0:9519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa13c582691d36d2f 00000100:00080000:0.0:1788725796.215819:0:9519:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788725796.215826:0:9519:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b13af852000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725796.215959:0:9519:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b139e748380 x1875614791408384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788725796.215992:0:9519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788725796.216136:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791408384:0@lo:38: 00000100:00100000:2.0:1788725796.216230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.216316:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408384 00000100:00100000:2.0:1788725796.216324:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408384 00000100:00100000:2.0:1788725796.216379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788725796.216389:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791408384:12345-0@lo:38: 00010000:00080000:2.0:1788725796.216419:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1788725796.216466:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa13c582691d36d36 00000004:00100000:2.0:1788725796.216486:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788725796.216527:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9b12826ee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725796.216595:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875614791408384:12345-0@lo:38: Request processed in 205us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725796.216603:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788725796.216772:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b139e748380 x1875614791408384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788725806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725796.216784:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788725796.216794:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788725796.216801:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788725796.216807:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788725796.216809:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788725796.216815:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791408384:0@lo:38: 00000040:00080000:0.0:1788725796.216951:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788725796.217069:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788725796.217106:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725796.217154:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.217167:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788725796.217226:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788725796.217229:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788725796.217230:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725796.217231:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725796.217232:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725796.217233:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725796.217235:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725796.217236:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725796.217238:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725796.217240:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725796.217241:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788725796.217246:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788725796.217250:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788725796.217251:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788725796.217252:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788725796.217253:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788725796.217254:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788725796.217255:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788725796.217256:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788725796.217257:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788725796.217258:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788725796.217259:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788725796.217260:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788725796.217282:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788725796.217298:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791408512:0@lo:253: 00000100:00100000:2.0:1788725796.217347:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.217389:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282064000 going to sleep for 11 seconds 00000100:00100000:2.0:1788725796.217434:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408512 00000100:00100000:2.0:1788725796.217440:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408512 00000100:00100000:2.0:1788725796.217489:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788725796.217500:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791408512:12345-0@lo:253: 20000000:01000000:2.0:1788725796.217526:0:6504:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788725796.217544:0:6504:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788725796.228614:0:6504:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788725796.228638:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788725796.228831:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788725796.228851:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788725796.228880:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.228903:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c2c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.228912:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36c72 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.228921:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.229028:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 17 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.229048:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 17 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.229079:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791408640:0@lo:104: 00000100:00100000:2.0:1788725796.229490:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725796.229615:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725796.229627:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 17 pid: 6505 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725796.229636:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791408768:0@lo:104: 00000100:00100000:2.0:1788725796.229661:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725796.230755:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9502:x1875614791408512:12345-0@lo:253: Request processed in 13248us (13399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.230769:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788725796.230963:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9502:1875614791408512:0@lo:253: 10000000:01000000:3.0:1788725796.230990:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788725796.230994:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788725796.230997:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788725796.230998:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788725796.231000:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788725796.231002:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788725796.231003:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788725796.231005:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788725796.231007:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788725796.231009:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788725796.231011:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788725796.231012:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788725796.231030:0:9502:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788725796.237572:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282064900 going to sleep for 11 seconds 00000100:00100000:1.0:1788725796.237638:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408640 00000100:00100000:1.0:1788725796.237654:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408640 00000100:00100000:1.0:1788725796.237715:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408768 00000100:00100000:1.0:1788725796.237719:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408768 00000100:00100000:1.0:1788725796.237745:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788725796.237756:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791408640:12345-0@lo:104: 00010000:00010000:1.0:1788725796.237777:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.237902:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725796.237909:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:6526:x1875614791408640:12345-0@lo:104: Request processed in 156us (8421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.237917:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788725796.238693:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788725796.238708:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791408768:12345-0@lo:104: 00010000:00010000:1.0:1788725796.238722:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725796.238802:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788725796.238809:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:6526:x1875614791408768:12345-0@lo:104: Request processed in 105us (9147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725796.238816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788725796.239046:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725796.239056:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239078:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6ae600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.239083:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239094:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.239102:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.239108:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.239172:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239179:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.239202:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239210:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c79 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239224:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725796.239227:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239233:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725796.239236:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239252:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725796.239258:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725796.239263:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725796.239278:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239284:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725796.239298:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239305:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36c33 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725796.239320:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.239322:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725796.239324:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725796.239333:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788725796.239542:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725796.240253:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791408896:0@lo:103: 00000100:00100000:3.0:1788725796.240337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725796.240507:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791409024:0@lo:103: 00000100:00100000:3.0:1788725796.240532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725796.240644:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791408640:0@lo:104: 00000100:00100000:2.0:1788725796.240673:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1875614791408768:0@lo:104: 00010000:00010000:2.0:1788725796.240702:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788725796.242256:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788725796.242717:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788725796.242926:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788725796.243505:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788725796.243776:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788725796.244047:0:9502:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1788725796.244891:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791408896 00000100:00100000:0.0:1788725796.244906:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791408896 00010000:00010000:0.0:1788725796.244958:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 17 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.245024:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409024 00000100:00100000:0.0:1788725796.245028:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409024 00010000:00010000:0.0:1788725796.245042:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 18 pid: 6505 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.245072:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788725796.245083:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3640:x1875614791408896:12345-0@lo:103: 00010000:00010000:0.0:1788725796.245099:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725796.245134:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245150:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245171:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148b600/0xa13c582691d36c79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c72 expref: 18 pid: 6506 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245190:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725796.245609:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3640:x1875614791408896:12345-0@lo:103: Request processed in 525us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.245617:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788725796.245644:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788725796.245669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3638:x1875614791409024:12345-0@lo:103: 00010000:00010000:0.0:1788725796.245678:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725796.245683:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 16 pid: 6505 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245694:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 16 pid: 6505 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245705:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36c2c expref: 16 pid: 6505 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245720:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245729:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788725796.245747:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022115605s 00010000:00010000:0.0:1788725796.245752:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245759:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245766:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245773:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245780:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ea00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725796.245793:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245802:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245825:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245837:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725796.245878:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3638:x1875614791409024:12345-0@lo:103: Request processed in 211us (5345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725796.245885:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788725796.245916:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245926:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725796.245933:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36d3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725796.245981:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791409024:0@lo:103: 00000100:00100000:0.0:1788725796.246024:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791408896:0@lo:103: 00000001:00000004:3.0:1788725796.248382:0:9502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788725796.260549:0:9502:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788725796.260563:0:9502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788725796.260613:0:9502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788725796.260668:0:9502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788725796.260695:0:9502:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788725796.260723:0:9502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788725796.263238:0:9502:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788725796.264627:0:9502:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788725796.731458:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725797.329515:0:9576:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725797.331619:0:9576:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788725797.755477:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725798.024900:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725798.024946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791409152:0@lo:41: 00000100:00100000:0.0:1788725798.025055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725798.025343:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409152 00000100:00100000:3.0:1788725798.025355:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409152 00000100:00100000:3.0:1788725798.025414:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788725798.025425:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791409152:12345-0@lo:41: 00000004:00000024:3.0:1788725798.025481:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788725798.025544:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791409152:12345-0@lo:41: Request processed in 119us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725798.025551:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788725798.025607:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791409152:0@lo:41: 00010000:00010000:1.0:1788725798.779292:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725799.547949:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791409280:0@lo:41: 00000100:00100000:0.0:1788725799.548055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725799.548381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409280 00000100:00100000:3.0:1788725799.548390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409280 00000100:00100000:3.0:1788725799.548448:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788725799.548457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791409280:12345-0@lo:41: 00000004:00000024:3.0:1788725799.548490:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788725799.548537:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791409280:12345-0@lo:41: Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725799.548555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725799.548693:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791409280:0@lo:41: 00010000:00010000:0.0:1788725799.810899:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725800.059372:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791409408:0@lo:13: 00000100:00100000:0.0:1788725800.059383:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725800.059403:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791409536:0@lo:13: 00000100:00100000:3.0:1788725800.066829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725800.069337:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409408 00000100:00100000:0.0:1788725800.069357:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409408 00000100:00100000:0.0:1788725800.069469:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788725800.069485:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791409408:12345-0@lo:13: 00002000:00000024:0.0:1788725800.069532:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788725800.069627:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725800.069663:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791409408:12345-0@lo:13: Request processed in 173us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725800.069672:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788725800.069704:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d9c00 x1875614791409408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725800.069712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725800.069737:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791409408:0@lo:13: 00000100:00100000:2.0:1788725800.069814:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409536 00000100:00100000:2.0:1788725800.069820:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409536 00000100:00100000:2.0:1788725800.069878:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788725800.069888:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791409536:12345-0@lo:13: 00002000:00000024:2.0:1788725800.069901:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725800.069946:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791409536:12345-0@lo:13: Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725800.069952:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788725800.070035:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725800.070057:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e749c00 x1875614791409536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725800.070070:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791409536:0@lo:13: 00010000:00010000:3.0:1788725800.832492:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788725801.595433:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788725801.595441:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139e52d000 from 39 10000000:01000000:1.0:1788725801.595447:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725801.595494:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.595507:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.595518:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725801.595543:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791409664:0@lo:101: 00000100:00100000:1.0:1788725801.595612:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.595659:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.596757:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409664 00000100:00100000:3.0:1788725801.596768:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409664 00000100:00100000:3.0:1788725801.596815:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788725801.596826:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791409664:12345-0@lo:101: 00010000:00010000:3.0:1788725801.596841:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725801.596855:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d44 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.596879:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d44 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.596889:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d44 expref: 16 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.596898:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179c00, rc 0) 00000100:00100000:3.0:1788725801.596954:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791409664:12345-0@lo:101: Request processed in 130us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.596960:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788725801.599688:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791409792:0@lo:400: 00000100:00100000:1.0:1788725801.599756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.599790:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791410304:0@lo:400: 00000100:00100000:1.0:1788725801.599810:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.599833:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791410816:0@lo:400: 00000100:00100000:1.0:1788725801.599873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.599895:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788725801.599900:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791410176:0@lo:400: 00000100:00100000:1.0:1788725801.599925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.599943:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791410688:0@lo:400: 00000100:00100000:1.0:1788725801.599967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.599993:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791409920:0@lo:400: 00000100:00100000:1.0:1788725801.600018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.600034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791410432:0@lo:400: 00000100:00100000:1.0:1788725801.600051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.600065:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791410944:0@lo:400: 00000100:00100000:1.0:1788725801.600088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.600102:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788725801.600107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791410048:0@lo:400: 00000100:00100000:1.0:1788725801.600149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.600159:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791410560:0@lo:400: 00000100:00100000:1.0:1788725801.600178:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.600209:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409792 00000100:00100000:1.0:1788725801.600217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409792 00000100:00100000:1.0:1788725801.600251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410304 00000100:00100000:1.0:1788725801.600254:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410304 00000100:00100000:1.0:1788725801.600275:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410816 00000100:00100000:1.0:1788725801.600278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410816 00000100:00100000:1.0:1788725801.600290:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410432 00000100:00100000:1.0:1788725801.600293:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410432 00000100:00100000:1.0:1788725801.600304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410944 00000100:00100000:1.0:1788725801.600306:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410944 00000100:00100000:1.0:1788725801.600327:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410048 00000100:00100000:1.0:1788725801.600329:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410048 00000100:00100000:1.0:1788725801.600343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788725801.600351:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791409792:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600402:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791409792:12345-0@lo:400: Request processed in 52us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600408:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788725801.600439:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725801.600446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791410304:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600472:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791410304:12345-0@lo:400: Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600478:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725801.600488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725801.600494:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791410816:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600518:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791410816:12345-0@lo:400: Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788725801.600533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725801.600538:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791410432:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600566:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791410432:12345-0@lo:400: Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725801.600580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788725801.600585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791410944:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791410944:12345-0@lo:400: Request processed in 21us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788725801.600631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725801.600636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791410048:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600662:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791410048:12345-0@lo:400: Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725801.600684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410176 00000100:00100000:1.0:1788725801.600688:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410176 00000100:00100000:1.0:1788725801.600708:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791409920 00000100:00100000:1.0:1788725801.600710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791409920 00000100:00100000:1.0:1788725801.600720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788725801.600725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791410176:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791410176:12345-0@lo:400: Request processed in 26us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788725801.600766:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788725801.600771:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791409920:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600792:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791409920:12345-0@lo:400: Request processed in 21us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788725801.600810:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410688 00000100:00100000:1.0:1788725801.600813:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410688 00000100:00100000:1.0:1788725801.600835:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791410560 00000100:00100000:1.0:1788725801.600837:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791410560 00000100:00100000:1.0:1788725801.600854:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788725801.600860:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791410688:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600888:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791410688:12345-0@lo:400: Request processed in 28us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600900:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788725801.600911:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788725801.600917:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791410560:12345-0@lo:400: 00000100:00100000:1.0:1788725801.600944:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791410560:12345-0@lo:400: Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.600950:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788725801.600976:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725801.600980:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788725801.601012:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f3480 x1875614791410048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601026:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791410048:0@lo:400: 00010000:00080000:1.0:1788725801.601036:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0380 x1875614791410560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601046:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791410560:0@lo:400: 00000100:00100000:1.0:1788725801.601054:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791409920:0@lo:400: 00010000:00080000:1.0:1788725801.601062:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f3100 x1875614791410432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601069:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791410432:0@lo:400: 00010000:00080000:1.0:1788725801.601077:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0700 x1875614791410944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601084:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791410944:0@lo:400: 00000100:00100000:1.0:1788725801.601143:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791409664:0@lo:101: 00010000:00010000:1.0:1788725801.601163:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.601180:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725801.601242:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411072:0@lo:501: 00000100:00100000:1.0:1788725801.601268:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.601294:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725801.601307:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411072 00000100:00100000:1.0:1788725801.601310:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411072 00000100:00100000:1.0:1788725801.601334:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788725801.601341:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791411072:12345-0@lo:501: 00000100:00100000:1.0:1788725801.601401:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791410176:0@lo:400: 00010000:00080000:1.0:1788725801.601427:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f2680 x1875614791410688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601435:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791410688:0@lo:400: 00010000:00080000:1.0:1788725801.601447:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f3b80 x1875614791409792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601454:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791409792:0@lo:400: 00010000:00080000:1.0:1788725801.601463:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f3800 x1875614791410304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601470:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791410304:0@lo:400: 00010000:00080000:1.0:1788725801.601478:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0e00 x1875614791410816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.601486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791410816:0@lo:400: 00000100:00100000:1.0:1788725801.602199:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791411072:12345-0@lo:501: Request processed in 854us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.602208:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788725801.604972:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411072:0@lo:501: 00000100:00100000:3.0:1788725801.605034:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411200:0@lo:503: 00000100:00100000:3.0:1788725801.605105:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.605176:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725801.606659:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411200 00000100:00100000:1.0:1788725801.606672:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411200 00000100:00100000:1.0:1788725801.606733:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788725801.606744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791411200:12345-0@lo:503: 00000100:00100000:1.0:1788725801.606912:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791411200:12345-0@lo:503: Request processed in 169us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.606920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788725801.606979:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411200:0@lo:503: 00000100:00100000:0.0:1788725801.617818:0:9802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9802:1875614791411328:0@lo:502: 00000100:00100000:0.0:1788725801.617911:0:9802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.617955:0:9802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.618640:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411328 00000100:00100000:2.0:1788725801.618650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411328 00000100:00100000:2.0:1788725801.618707:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788725801.618717:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9802:x1875614791411328:12345-0@lo:502: 00000100:00100000:2.0:1788725801.618867:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9802:x1875614791411328:12345-0@lo:502: Request processed in 151us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.618876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788725801.619100:0:9802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9802:1875614791411328:0@lo:502: 00000100:00100000:0.0:1788725801.619186:0:9802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9802:1875614791411456:0@lo:502: 00000100:00100000:0.0:1788725801.619227:0:9802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.619250:0:9802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.619319:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411456 00000100:00100000:2.0:1788725801.619323:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411456 00000100:00100000:2.0:1788725801.619355:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788725801.619363:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9802:x1875614791411456:12345-0@lo:502: 00000100:00100000:2.0:1788725801.619442:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:9802:x1875614791411456:12345-0@lo:502: Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.619457:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788725801.619536:0:9802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9802:1875614791411456:0@lo:502: 00000040:00080000:0.0:1788725801.619557:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788725801.620069:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788725801.620091:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788725801.620100:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.620110:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725801.620132:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788725801.620135:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788725801.620138:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788725801.620163:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.620171:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.620180:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725801.620193:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411584:0@lo:101: 00000100:00100000:2.0:1788725801.620220:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.620241:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.625076:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411584 00000100:00100000:0.0:1788725801.625091:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411584 00000100:00100000:0.0:1788725801.625191:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788725801.625202:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791411584:12345-0@lo:101: 00010000:00010000:0.0:1788725801.625220:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725801.625239:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d52 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.625267:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d52 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.625279:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d52 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.625289:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae800, rc 0) 00000100:00100000:0.0:1788725801.625363:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791411584:12345-0@lo:101: Request processed in 162us (5141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.625370:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788725801.625441:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411584:0@lo:101: 00010000:00010000:0.0:1788725801.625459:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.625469:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.625541:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411712:0@lo:501: 00000100:00100000:0.0:1788725801.625584:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.625613:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.625626:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411712 00000100:00100000:0.0:1788725801.625629:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411712 00000100:00100000:0.0:1788725801.625652:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788725801.625659:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791411712:12345-0@lo:501: 00000100:00100000:0.0:1788725801.625764:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791411712:12345-0@lo:501: Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.625771:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788725801.625800:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411712:0@lo:501: 00000100:00100000:0.0:1788725801.625825:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411840:0@lo:503: 00000100:00100000:0.0:1788725801.626259:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.626279:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.626332:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411840 00000100:00100000:3.0:1788725801.626342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411840 00000100:00100000:3.0:1788725801.626375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788725801.626383:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791411840:12345-0@lo:503: 00000100:00100000:3.0:1788725801.626480:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791411840:12345-0@lo:503: Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.626487:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788725801.626566:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791411840:0@lo:503: 00000100:00100000:0.0:1788725801.629372:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9803:1875614791411968:0@lo:502: 00000100:00100000:0.0:1788725801.629459:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.629503:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.629559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791411968 00000100:00100000:2.0:1788725801.629567:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791411968 00000100:00100000:2.0:1788725801.629616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788725801.629626:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9803:x1875614791411968:12345-0@lo:502: 00000100:00100000:2.0:1788725801.629747:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9803:x1875614791411968:12345-0@lo:502: Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.629760:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788725801.629865:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9803:1875614791411968:0@lo:502: 00000020:01000000:0.0:1788725801.629894:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725801.629904:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.629906:0:9803:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725801.629912:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725801.629914:0:9803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788725801.629931:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9803:1875614791412096:0@lo:502: 00000100:00100000:0.0:1788725801.629963:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.629990:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.630162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412096 00000100:00100000:2.0:1788725801.630166:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412096 00000100:00100000:2.0:1788725801.630192:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788725801.630199:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9803:x1875614791412096:12345-0@lo:502: 00000100:00100000:2.0:1788725801.630264:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:9803:x1875614791412096:12345-0@lo:502: Request processed in 64us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.630272:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788725801.635010:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9803:1875614791412096:0@lo:502: 00000020:01000000:0.0:1788725801.635054:0:9803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725801.635063:0:9803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.635066:0:9803:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725801.635071:0:9803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788725801.635673:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788725801.635695:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788725801.635705:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.635717:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725801.635727:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788725801.635729:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b13bd660800 from 39 10000000:01000000:2.0:1788725801.635732:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725801.635765:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.635774:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.635782:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725801.635801:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412224:0@lo:101: 00000100:00100000:2.0:1788725801.635877:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.635918:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.636109:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412224 00000100:00100000:0.0:1788725801.636142:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412224 00000100:00100000:0.0:1788725801.636184:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788725801.636194:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791412224:12345-0@lo:101: 00010000:00010000:0.0:1788725801.636205:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725801.636217:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d60 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.636238:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d60 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.636248:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d60 expref: 18 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.636256:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6aec00, rc 0) 00000100:00100000:0.0:1788725801.636296:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412224:12345-0@lo:101: Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.636302:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788725801.636342:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412224:0@lo:101: 00010000:00010000:0.0:1788725801.636354:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.636362:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.636435:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412352:0@lo:501: 00000100:00100000:0.0:1788725801.636460:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.636477:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.636490:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412352 00000100:00100000:0.0:1788725801.636493:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412352 00000100:00100000:0.0:1788725801.636513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788725801.636520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412352:12345-0@lo:501: 00000100:00100000:0.0:1788725801.636620:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412352:12345-0@lo:501: Request processed in 100us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.636627:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788725801.636655:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412352:0@lo:501: 00000100:00100000:0.0:1788725801.636680:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412480:0@lo:503: 00000100:00100000:0.0:1788725801.636718:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.636732:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.636743:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412480 00000100:00100000:0.0:1788725801.636746:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412480 00000100:00100000:0.0:1788725801.636765:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788725801.636772:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412480:12345-0@lo:503: 00000100:00100000:0.0:1788725801.636864:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412480:12345-0@lo:503: Request processed in 77us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.636870:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788725801.636908:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412480:0@lo:503: 00000100:00100000:0.0:1788725801.637069:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9804:1875614791412608:0@lo:502: 00000100:00100000:0.0:1788725801.637101:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.637148:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412608 00000100:00100000:0.0:1788725801.637152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412608 00000100:00100000:0.0:1788725801.637173:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788725801.637179:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:9804:x1875614791412608:12345-0@lo:502: 00000100:00100000:0.0:1788725801.637247:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:9804:x1875614791412608:12345-0@lo:502: Request processed in 68us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.637254:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788725801.637286:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.637298:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9804:1875614791412608:0@lo:502: 00000100:00100000:0.0:1788725801.637334:0:9804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9804:1875614791412736:0@lo:502: 00000100:00100000:0.0:1788725801.637363:0:9804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.637381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412736 00000100:00100000:0.0:1788725801.637385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412736 00000100:00100000:0.0:1788725801.637403:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788725801.637408:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:9804:x1875614791412736:12345-0@lo:502: 00000100:00100000:0.0:1788725801.637470:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:9804:x1875614791412736:12345-0@lo:502: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.637477:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788725801.637505:0:9804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.637516:0:9804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9804:1875614791412736:0@lo:502: 00000040:00080000:0.0:1788725801.637532:0:9804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788725801.637572:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788725801.637588:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788725801.637595:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637603:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725801.637616:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788725801.637618:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b13bd660800 from 6 10000000:01000000:0.0:1788725801.637620:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788725801.637639:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637646:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637654:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.637665:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412864:0@lo:101: 00000100:00100000:0.0:1788725801.637689:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.637701:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.637712:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412864 00000100:00100000:0.0:1788725801.637715:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412864 00000100:00100000:0.0:1788725801.637734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788725801.637740:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791412864:12345-0@lo:101: 00010000:00010000:0.0:1788725801.637748:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725801.637758:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d6e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637774:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d6e expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637782:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d6e expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637799:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae400, rc 0) 00000100:00100000:0.0:1788725801.637826:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791412864:12345-0@lo:101: Request processed in 86us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.637832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788725801.637859:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412864:0@lo:101: 00010000:00010000:0.0:1788725801.637869:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.637877:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.637917:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412992:0@lo:256: 00000100:00100000:0.0:1788725801.637946:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.637958:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.637968:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791412992 00000100:00100000:0.0:1788725801.637971:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791412992 00000100:00100000:0.0:1788725801.637988:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788725801.637994:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791412992:12345-0@lo:256: 20000000:01000000:0.0:1788725801.638005:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788725801.638021:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788725801.638024:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788725801.638092:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791412992:12345-0@lo:256: Request processed in 98us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.638099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788725801.638154:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791412992:0@lo:256: 10000000:01000000:0.0:1788725801.638191:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788725801.638200:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638207:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725801.638213:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788725801.638215:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788725801.638217:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788725801.638229:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638236:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638242:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.638251:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413120:0@lo:101: 00000100:00100000:0.0:1788725801.638272:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.638290:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.638299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413120 00000100:00100000:0.0:1788725801.638302:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413120 00000100:00100000:0.0:1788725801.638320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788725801.638326:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791413120:12345-0@lo:101: 00010000:00010000:0.0:1788725801.638331:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725801.638338:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d7c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638350:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d7c expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638364:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d7c expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638371:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae000, rc 0) 00000100:00100000:0.0:1788725801.638397:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413120:12345-0@lo:101: Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.638402:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788725801.638446:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413120:0@lo:101: 00010000:00010000:0.0:1788725801.638456:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.638464:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.638506:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413248:0@lo:501: 00000100:00100000:0.0:1788725801.638529:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.638541:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.638551:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413248 00000100:00100000:0.0:1788725801.638554:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413248 00000100:00100000:0.0:1788725801.638573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788725801.638579:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413248:12345-0@lo:501: 00000100:00100000:0.0:1788725801.638660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413248:12345-0@lo:501: Request processed in 80us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.638666:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788725801.638693:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413248:0@lo:501: 00000100:00100000:0.0:1788725801.638716:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413376:0@lo:503: 00000100:00100000:0.0:1788725801.638754:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.638767:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.638777:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413376 00000100:00100000:0.0:1788725801.638780:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413376 00000100:00100000:0.0:1788725801.638798:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788725801.638804:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413376:12345-0@lo:503: 00000100:00100000:0.0:1788725801.638877:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413376:12345-0@lo:503: Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.638883:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788725801.638920:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413376:0@lo:503: 00000100:00100000:2.0:1788725801.643524:0:9805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9805:1875614791413504:0@lo:502: 00000100:00100000:2.0:1788725801.643610:0:9805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.643650:0:9805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.643706:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413504 00000100:00100000:0.0:1788725801.643713:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413504 00000100:00100000:0.0:1788725801.643764:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788725801.643774:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:9805:x1875614791413504:12345-0@lo:502: 00000100:00100000:0.0:1788725801.643920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:9805:x1875614791413504:12345-0@lo:502: Request processed in 147us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.643929:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788725801.644142:0:9805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9805:1875614791413504:0@lo:502: 00000020:01000000:2.0:1788725801.644169:0:9805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788725801.644176:0:9805:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788725801.644182:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725801.644184:0:9805:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788725801.644190:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788725801.644193:0:9805:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788725801.644213:0:9805:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788725801.644215:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788725801.644229:0:9805:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b128252cd28) 00000020:00000080:2.0:1788725801.644251:0:9805:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788725801.644255:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788725801.644350:0:9805:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788725801.644356:0:9805:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788725801.644363:0:9805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d36d91 00010000:00080000:2.0:1788725801.644393:0:9805:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b12834b3800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788725801.644628:0:9805:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788725801.644751:0:9805:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788725801.644762:0:9805:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788725801.644960:0:9805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725801.645049:0:9805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788725801.645200:0:9805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788725801.645297:0:9805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788725801.649601:0:9806:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725801.649615:0:9806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788725801.655827:0:9805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788725801.655845:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788725801.655909:0:9805:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788725801.655938:0:9805:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36d98 00000100:00080000:2.0:1788725801.655951:0:9805:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788725801.655958:0:9805:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b12834b3800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788725801.655996:0:9805:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b12833d8700 x1875614791413632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788725801.656023:0:9805:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788725801.656088:0:9805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725801.656093:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725801.656096:0:9805:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788725801.656099:0:9805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725801.656104:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725801.656105:0:9805:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788725801.656109:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788725801.656111:0:9805:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788725801.656175:0:9805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9805:1875614791413760:0@lo:502: 00000100:00100000:2.0:1788725801.656258:0:9805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.656297:0:9805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed000 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.656321:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413760 00000100:00100000:2.0:1788725801.656327:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413760 00000100:00100000:2.0:1788725801.656367:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788725801.656377:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:9805:x1875614791413760:12345-0@lo:502: 00000100:00100000:2.0:1788725801.656506:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:9805:x1875614791413760:12345-0@lo:502: Request processed in 130us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.656514:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788725801.656563:0:9805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9805:1875614791413760:0@lo:502: 00000020:01000000:2.0:1788725801.656590:0:9805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725801.656594:0:9805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725801.656595:0:9805:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788725801.656599:0:9805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1788725801.657024:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791413632:0@lo:8: 00000100:00100000:0.0:1788725801.657073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788725801.657149:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788725801.657173:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788725801.657185:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.657197:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725801.657222:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788725801.657225:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139116a000 from 39 10000000:01000000:0.0:1788725801.657228:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788725801.657257:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.657265:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.657276:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.657290:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413888:0@lo:101: 00000100:00100000:0.0:1788725801.657322:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.657423:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.657497:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413888 00000100:00100000:2.0:1788725801.657502:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413888 00000100:00100000:3.0:1788725801.657591:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791413632 00000100:00100000:3.0:1788725801.657595:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791413632 00000100:00100000:3.0:1788725801.657620:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788725801.657627:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791413632:12345-0@lo:8: 00010000:00080000:3.0:1788725801.657653:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1788725801.657682:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d36da6 00002000:00100000:3.0:1788725801.657695:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b139e606000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788725801.657699:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788725801.657702:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788725801.657762:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788725801.658061:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788725801.658071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791413888:12345-0@lo:101: 00010000:00010000:2.0:1788725801.658082:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725801.658095:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36d9f expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.658132:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36d9f expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.658144:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d9f expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.658154:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e800, rc 0) 00000100:00100000:2.0:1788725801.658203:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791413888:12345-0@lo:101: Request processed in 134us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.658210:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788725801.658299:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791413888:0@lo:101: 00010000:00010000:0.0:1788725801.658314:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725801.658322:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725801.658378:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414016:0@lo:501: 00000100:00100000:0.0:1788725801.658402:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.658434:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.658448:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414016 00000100:00100000:0.0:1788725801.658451:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414016 00000100:00100000:0.0:1788725801.658474:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788725801.658490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791414016:12345-0@lo:501: 00000100:00100000:0.0:1788725801.658587:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791414016:12345-0@lo:501: Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.658593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788725801.658620:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414016:0@lo:501: 00000100:00100000:0.0:1788725801.658643:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414144:0@lo:503: 00000100:00100000:0.0:1788725801.658684:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.658697:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.658707:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414144 00000100:00100000:0.0:1788725801.658711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414144 00000100:00100000:0.0:1788725801.658727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788725801.658732:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791414144:12345-0@lo:503: 00000100:00100000:0.0:1788725801.658817:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791414144:12345-0@lo:503: Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.658824:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00002000:00080000:3.0:1788725801.659164:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788725801.659190:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b139e604000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725801.659237:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791413632:12345-0@lo:8: Request processed in 1609us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.659245:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788725801.659285:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d8700 x1875614791413632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.659295:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788725801.659302:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788725801.659310:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788725801.659315:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788725801.659323:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b12834b3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788725801.663899:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788725801.663917:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791413632:0@lo:8: 00000100:00100000:0.0:1788725801.666363:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414144:0@lo:503: 00000100:00100000:0.0:1788725801.666474:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791414272:0@lo:700: 00000100:00100000:0.0:1788725801.666533:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.666568:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389e7f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.666901:0:9808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9808:1875614791414400:0@lo:502: 00000100:00100000:0.0:1788725801.666945:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.667014:0:9808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725801.667220:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414272 00000100:00100000:1.0:1788725801.667227:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414272 00000100:00100000:1.0:1788725801.667283:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725801.667293:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9807:x1875614791414272:12345-0@lo:700: 00000100:00100000:1.0:1788725801.667329:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1875614791414528:0@lo:700: 00000100:00100000:1.0:1788725801.667360:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.667378:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788725801.667395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414528 00000100:00100000:1.0:1788725801.667398:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414528 00000100:00100000:1.0:1788725801.667436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788725801.667443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1875614791414528:12345-0@lo:700: 00000100:00080000:0.0:1788725801.667592:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788725801.668175:0:9806:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788725801.668237:0:9806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 246824118942ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788725801.668245:0:9806:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788725801.672068:0:7442:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788725801.674101:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414400 00000100:00100000:3.0:1788725801.674127:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414400 00000100:00100000:3.0:1788725801.674189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788725801.674199:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:9808:x1875614791414400:12345-0@lo:502: 00000100:00100000:3.0:1788725801.674377:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:9808:x1875614791414400:12345-0@lo:502: Request processed in 179us (7431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.674386:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788725801.674472:0:9808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9808:1875614791414400:0@lo:502: 00000100:00100000:3.0:1788725801.674548:0:9808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9808:1875614791414656:0@lo:502: 00000100:00100000:3.0:1788725801.674590:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.674615:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414656 00000100:00100000:3.0:1788725801.674619:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414656 00000100:00100000:3.0:1788725801.674641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788725801.674648:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:9808:x1875614791414656:12345-0@lo:502: 00000100:00100000:3.0:1788725801.674707:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:9808:x1875614791414656:12345-0@lo:502: Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.674713:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788725801.674751:0:9808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.674764:0:9808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9808:1875614791414656:0@lo:502: 00000040:00080000:3.0:1788725801.674782:0:9808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788725801.674869:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788725801.674890:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725801.674900:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.674918:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725801.674929:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788725801.674932:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139116a000 from 6 10000000:01000000:3.0:1788725801.674936:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788725801.675161:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675171:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675180:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725801.675192:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414784:0@lo:101: 00000100:00100000:3.0:1788725801.675220:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.675234:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.675246:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414784 00000100:00100000:3.0:1788725801.675249:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414784 00000100:00100000:3.0:1788725801.675269:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788725801.675275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791414784:12345-0@lo:101: 00010000:00010000:3.0:1788725801.675283:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725801.675295:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179800/0xa13c582691d36dbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36db4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675316:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179800/0xa13c582691d36dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36db4 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675338:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179800/0xa13c582691d36dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36db4 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675349:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179800, rc 0) 00000100:00100000:3.0:1788725801.675380:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791414784:12345-0@lo:101: Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.675386:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788725801.675432:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414784:0@lo:101: 00010000:00010000:3.0:1788725801.675445:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675454:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725801.675496:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414912:0@lo:256: 00000100:00100000:3.0:1788725801.675524:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.675537:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.675548:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791414912 00000100:00100000:3.0:1788725801.675551:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791414912 00000100:00100000:3.0:1788725801.675571:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788725801.675577:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791414912:12345-0@lo:256: 20000000:01000000:3.0:1788725801.675590:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788725801.675605:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788725801.675608:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788725801.675678:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791414912:12345-0@lo:256: Request processed in 101us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.675685:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788725801.675720:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791414912:0@lo:256: 10000000:01000000:3.0:1788725801.675757:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788725801.675763:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675771:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725801.675779:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788725801.675780:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788725801.675783:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788725801.675795:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675803:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.675811:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725801.675821:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415040:0@lo:101: 00000100:00100000:3.0:1788725801.675841:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.677362:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415040 00000100:00100000:2.0:1788725801.677374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415040 00000100:00100000:3.0:1788725801.679239:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.679368:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788725801.679385:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791415040:12345-0@lo:101: 00010000:00010000:3.0:1788725801.679403:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725801.679433:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36dc2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.679476:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.679486:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.679495:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179600, rc 0) 00000100:00100000:3.0:1788725801.679556:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791415040:12345-0@lo:101: Request processed in 178us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.679563:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788725801.679617:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415040:0@lo:101: 00010000:00010000:3.0:1788725801.679635:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725801.679645:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725801.679726:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415168:0@lo:501: 00000100:00100000:3.0:1788725801.679760:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.679774:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.679787:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415168 00000100:00100000:3.0:1788725801.679792:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415168 00000100:00100000:3.0:1788725801.680247:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788725801.680256:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791415168:12345-0@lo:501: 00000100:00100000:3.0:1788725801.680430:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791415168:12345-0@lo:501: Request processed in 175us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.680437:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 40000000:02000000:2.0:1788725801.690492:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788725801.690984:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415168:0@lo:501: 00000100:00100000:0.0:1788725801.691052:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415296:0@lo:503: 00000100:00100000:0.0:1788725801.691144:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.691187:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.692058:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415296 00000100:00100000:3.0:1788725801.692068:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415296 00000100:00100000:3.0:1788725801.692128:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788725801.692138:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791415296:12345-0@lo:503: 00000100:00100000:3.0:1788725801.692262:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791415296:12345-0@lo:503: Request processed in 125us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.692269:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788725801.692323:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791415296:0@lo:503: 00000100:00100000:0.0:1788725801.695399:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9811:1875614791415424:0@lo:502: 00000100:00100000:0.0:1788725801.695494:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.695544:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e798a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.695606:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415424 00000100:00100000:3.0:1788725801.695613:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415424 00000100:00100000:3.0:1788725801.698530:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788725801.698557:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:9811:x1875614791415424:12345-0@lo:502: 00000100:00100000:3.0:1788725801.700862:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:9811:x1875614791415424:12345-0@lo:502: Request processed in 2309us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.700878:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788725801.702018:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9811:1875614791415424:0@lo:502: 00000020:01000000:0.0:1788725801.702063:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788725801.702070:0:9811:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788725801.702079:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.702081:0:9811:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788725801.702088:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788725801.702093:0:9811:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1788725801.702135:0:9811:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788725801.702139:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788725801.702155:0:9811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b13be9a99b8) 00000020:00000080:0.0:1788725801.702180:0:9811:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788725801.702187:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788725801.702302:0:9811:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788725801.702309:0:9811:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788725801.702317:0:9811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d36dd7 00010000:00080000:0.0:1788725801.702357:0:9811:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1283543800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788725801.702616:0:9811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788725801.702744:0:9811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788725801.702759:0:9811:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788725801.704181:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8434:x1875614791414528:12345-0@lo:700: Request processed in 36732us (36813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.704200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788725801.704437:0:8434:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0e00 x1875614791414528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725801.704463:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8434:1875614791414528:0@lo:700: 40000000:02000000:2.0:1788725801.704475:0:8434:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1788725801.705441:0:9811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725801.705582:0:9811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725801.705721:0:9811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788725801.707029:0:9811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788725801.713908:0:9812:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788725801.713916:0:9812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1788725801.720756:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788725801.721046:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791414272:12345-0@lo:700: Request processed in 53750us (54507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.721066:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788725801.721144:0:9807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e74a300 x1875614791414272/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725801.721158:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791414272:0@lo:700: 00000020:00000080:0.0:1788725801.728504:0:9811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788725801.728519:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788725801.728579:0:9811:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788725801.728607:0:9811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36dde 00000100:00080000:0.0:1788725801.728617:0:9811:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788725801.728622:0:9811:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b1283543800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725801.728657:0:9811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b139e74bb80 x1875614791415552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788725801.728673:0:9811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788725801.728722:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725801.728727:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.728729:0:9811:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788725801.728732:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725801.728736:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.728737:0:9811:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788725801.728741:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788725801.728742:0:9811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788725801.728771:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9811:1875614791415680:0@lo:502: 00000100:00100000:0.0:1788725801.728863:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.728900:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13864fdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.729360:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791415552:0@lo:8: 00000100:00100000:2.0:1788725801.731154:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415680 00000100:00100000:2.0:1788725801.731166:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415680 00000100:00100000:2.0:1788725801.731260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788725801.731270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:9811:x1875614791415680:12345-0@lo:502: 00000100:00100000:2.0:1788725801.731426:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:9811:x1875614791415680:12345-0@lo:502: Request processed in 156us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.731433:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788725801.734937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.735047:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415552 00000100:00100000:3.0:1788725801.735056:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415552 00000100:00100000:3.0:1788725801.735090:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788725801.735098:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1875614791415552:12345-0@lo:8: 00010000:00080000:3.0:1788725801.735146:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1788725801.735177:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d36de5 00002000:00100000:3.0:1788725801.735191:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b139e600000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788725801.735204:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788725801.735208:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788725801.735286:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788725801.735312:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b139e601800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725801.735377:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791415552:12345-0@lo:8: Request processed in 279us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.735384:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788725801.735436:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e74bb80 x1875614791415552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788725811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.735447:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788725801.735455:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788725801.735464:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788725801.735469:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788725801.735471:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1283543800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788725801.735487:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788725801.735492:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791415552:0@lo:8: 00000004:00080000:3.0:1788725801.735837:0:9812:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788725801.736597:0:9812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 246892478451ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788725801.736607:0:9812:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788725801.737472:0:9813:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788725801.737498:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791415936:0@lo:7: 00000100:00100000:3.0:1788725801.737555:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.737792:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.737880:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415936 00000100:00100000:3.0:1788725801.737888:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415936 00000100:00100000:3.0:1788725801.737950:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788725801.737961:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9813:x1875614791415936:12345-0@lo:7: 00000100:00100000:1.0:1788725801.740753:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791415808:0@lo:13: 00000100:00100000:1.0:1788725801.741744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.741881:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791415808 00000100:00100000:1.0:1788725801.741896:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791415808 00000100:00100000:1.0:1788725801.741951:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788725801.741961:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791415808:12345-0@lo:13: 00002000:00000024:1.0:1788725801.741989:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923869696 avail 3692347392 00000100:00100000:1.0:1788725801.742035:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791415808:12345-0@lo:13: Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.742042:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788725801.742074:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a28e00 x1875614791415808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.742093:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791415808:0@lo:13: 00000004:00080000:0.0:1788725801.743021:0:9807:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788725801.743044:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416192:0@lo:7: 00000100:00100000:0.0:1788725801.743087:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.743133:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13864fd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.743147:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791416064:0@lo:13: 00000100:00100000:0.0:1788725801.743171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.743198:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416192 00000100:00100000:0.0:1788725801.743209:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416192 00000100:00100000:0.0:1788725801.743243:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788725801.743250:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791416192:12345-0@lo:7: 00000100:00100000:1.0:1788725801.743679:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416064 00000100:00100000:1.0:1788725801.743686:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416064 00000100:00100000:1.0:1788725801.743710:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788725801.743717:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791416064:12345-0@lo:13: 00002000:00000024:1.0:1788725801.743730:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923869696 avail 3692347392 00000100:00100000:1.0:1788725801.743771:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791416064:12345-0@lo:13: Request processed in 54us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.743778:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788725801.743899:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e74ad80 x1875614791416064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725801.743917:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791416064:0@lo:13: 00000100:00100000:0.0:1788725801.745217:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:9811:1875614791415680:0@lo:502: 00000020:01000000:0.0:1788725801.745260:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725801.745268:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725801.745270:0:9811:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788725801.745275:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788725801.746659:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788725801.746693:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788725801.746703:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.746716:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725801.746735:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788725801.746738:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b13a96d0000 from 1 10000000:01000000:1.0:1788725801.746741:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788725801.746775:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.746785:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.746796:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725801.746897:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791416320:0@lo:101: 00000100:00100000:1.0:1788725801.747026:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.747075:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.747681:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416320 00000100:00100000:2.0:1788725801.747692:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416320 00000100:00100000:2.0:1788725801.747739:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788725801.747749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791416320:12345-0@lo:101: 00010000:00010000:2.0:1788725801.747762:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725801.747776:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36dec expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.747933:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.748021:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725801.748031:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:2.0:1788725801.748087:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791416320:12345-0@lo:101: Request processed in 340us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725801.748094:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788725801.748210:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791416320:0@lo:101: 00010000:00010000:1.0:1788725801.748225:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.748236:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725801.748300:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791416448:0@lo:501: 00000100:00100000:1.0:1788725801.748330:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725801.748363:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.748900:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416448 00000100:00100000:2.0:1788725801.748907:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416448 00000100:00100000:2.0:1788725801.749007:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788725801.749017:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791416448:12345-0@lo:501: 00000100:00100000:2.0:1788725801.749102:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791416448:12345-0@lo:501: Request processed in 86us (771us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725801.749110:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788725801.749210:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791416448:0@lo:501: 10000000:01000000:1.0:1788725801.749238:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788725801.749253:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725801.749262:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788725801.752686:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788725801.752901:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788725801.755975:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788725801.755982:0:8425:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788725801.756067:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9813:x1875614791415936:12345-0@lo:7: Request processed in 18104us (18507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725801.756077:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788725801.756146:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a29880 x1875614791415936/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.756160:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791415936:0@lo:7: 00000004:00080000:3.0:1788725801.756173:0:9813:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788725801.756206:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791416576:0@lo:5: 00000100:00100000:3.0:1788725801.756235:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.756257:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725801.756273:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416576 00000100:00100000:3.0:1788725801.756278:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416576 00000100:00100000:3.0:1788725801.756312:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788725801.756320:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9813:x1875614791416576:12345-0@lo:5: 00002000:00080000:3.0:1788725801.756354:0:8426:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788725801.756358:0:8426:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1788725801.758500:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788725801.758509:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788725801.758717:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791416192:12345-0@lo:7: Request processed in 15461us (15624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.758728:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788725801.758778:0:9807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e748000 x1875614791416192/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725801.758793:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416192:0@lo:7: 00000004:00080000:0.0:1788725801.759228:0:9807:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788725801.759267:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416704:0@lo:5: 00000100:00100000:0.0:1788725801.759305:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725801.759334:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.759354:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416704 00000100:00100000:0.0:1788725801.759360:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416704 00000100:00100000:0.0:1788725801.759390:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725801.759399:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791416704:12345-0@lo:5: 00002000:00080000:0.0:1788725801.761488:0:8716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788725801.761579:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791416704:12345-0@lo:5: Request processed in 2176us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.761589:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788725801.761975:0:9807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e748000 x1875614791416704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725801.761990:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416704:0@lo:5: 00000004:00080000:2.0:1788725801.762005:0:9807:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788725801.762046:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416832:0@lo:5: 00000100:00100000:2.0:1788725801.762080:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725801.762110:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be972a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725801.762485:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416832 00000100:00100000:0.0:1788725801.762492:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416832 00000100:00100000:0.0:1788725801.762548:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788725801.762571:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9807:x1875614791416832:12345-0@lo:5: 00002000:00080000:0.0:1788725801.762604:0:8425:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788725801.764366:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9807:x1875614791416832:12345-0@lo:5: Request processed in 1803us (2279us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788725801.764377:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788725801.764452:0:9807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d8380 x1875614791416832/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.764485:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9807:1875614791416832:0@lo:5: 00000004:00080000:3.0:1788725801.764504:0:9807:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788725801.764571:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9807:1875614791416960:0@lo:900: 00000100:00100000:3.0:1788725801.764628:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.764687:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99b540 going to sleep for 11 seconds 00000001:00080000:3.0:1788725801.765335:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788725801.765352:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788725801.765644:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9813:x1875614791416576:12345-0@lo:5: Request processed in 9320us (9403us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788725801.765657:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788725801.765717:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a29880 x1875614791416576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.765729:0:9813:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788725801.765735:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791416576:0@lo:5: 00000004:00080000:3.0:1788725801.765751:0:9813:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788725801.765799:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791417088:0@lo:700: 00000100:00100000:3.0:1788725801.765830:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.765858:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.765916:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417088 00000100:00100000:2.0:1788725801.765928:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417088 00000100:00100000:2.0:1788725801.765992:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788725801.766002:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9813:x1875614791417088:12345-0@lo:700: 00000100:00100000:0.0:1788725801.767325:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791416960 00000100:00100000:0.0:1788725801.767337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791416960 00000100:00100000:0.0:1788725801.767386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788725801.767398:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9807:x1875614791416960:12345-0@lo:900: 00000100:00100000:0.0:1788725801.767505:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9807:x1875614791416960:12345-0@lo:900: Request processed in 110us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725801.767513:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788725801.767769:0:9807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a06300 x1875614791416960/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.767791:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9807:1875614791416960:0@lo:900: 00000001:00080000:3.0:1788725801.777009:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788725801.777325:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9813:x1875614791417088:12345-0@lo:700: Request processed in 11318us (11488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725801.777336:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788725801.777417:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a04380 x1875614791417088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725801.777434:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791417088:0@lo:700: 00000004:02000040:3.0:1788725801.778697:0:9813:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788725801.783288:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791417216:0@lo:5: 00000100:00100000:3.0:1788725801.783351:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725801.783454:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725801.783500:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417216 00000100:00100000:2.0:1788725801.783507:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417216 00000100:00100000:2.0:1788725801.783653:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788725801.783665:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9813:x1875614791417216:12345-0@lo:5: 00002000:00080000:3.0:1788725801.788741:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788725801.788761:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788725801.791049:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9813:x1875614791417216:12345-0@lo:5: Request processed in 7380us (7690us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788725801.791064:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788725801.791167:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a04380 x1875614791417216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788725817 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725801.791186:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875614791417216:0@lo:5: 00000004:00080000:2.0:1788725801.791202:0:9813:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788725801.851314:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725802.875355:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788725803.125209:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788725803.139169:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791417344:0@lo:41: 00000100:00100000:2.0:1788725803.139257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725803.139392:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417344 00000100:00100000:1.0:1788725803.139415:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417344 00000100:00100000:1.0:1788725803.139478:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725803.139489:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791417344:12345-0@lo:41: 00000004:00000024:1.0:1788725803.139532:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725803.140882:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791417344:12345-0@lo:41: Request processed in 1384us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725803.140897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788725803.141046:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791417344:0@lo:41: 00010000:00010000:3.0:1788725803.899533:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725804.178553:0:9928:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725804.178762:0:9928:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788725804.668375:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791417472:0@lo:41: 00000100:00100000:0.0:1788725804.668490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725804.668632:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417472 00000100:00100000:3.0:1788725804.668641:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417472 00000100:00100000:3.0:1788725804.668706:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788725804.668717:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791417472:12345-0@lo:41: 00000004:00000024:3.0:1788725804.668765:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788725804.668821:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791417472:12345-0@lo:41: Request processed in 105us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725804.668828:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788725804.669264:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791417472:0@lo:41: 00010000:00010000:0.0:1788725804.923695:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788725805.081632:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788725805.181545:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725805.181579:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791417600:0@lo:13: 00000100:00100000:3.0:1788725805.181668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725805.183833:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417600 00000100:00100000:0.0:1788725805.183853:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417600 00000100:00100000:0.0:1788725805.183961:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725805.183979:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791417600:12345-0@lo:13: 00002000:00000024:0.0:1788725805.184022:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725805.184150:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791417600:12345-0@lo:13: Request processed in 146us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725805.184176:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788725805.184331:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725805.184349:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791417728:0@lo:13: 00000100:00100000:2.0:1788725805.184410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725805.184577:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417728 00000100:00100000:1.0:1788725805.184583:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417728 00000100:00100000:1.0:1788725805.184614:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725805.184622:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791417728:12345-0@lo:13: 00002000:00000024:1.0:1788725805.184635:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725805.184682:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791417728:12345-0@lo:13: Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725805.184687:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788725805.184866:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725805.184907:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e74ad80 x1875614791417600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725805.184930:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791417600:0@lo:13: 00010000:00080000:2.0:1788725805.185071:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d8e00 x1875614791417728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725805.185084:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791417728:0@lo:13: 00010000:00010000:0.0:1788725805.947701:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725806.975472:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788725807.052340:0:10029:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788725807.052587:0:10029:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788725807.227351:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725807.227387:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791417856:0@lo:13: 00000100:00100000:1.0:1788725807.227451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725807.227702:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417856 00000100:00100000:3.0:1788725807.227710:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417856 00000100:00100000:3.0:1788725807.227813:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788725807.227824:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791417856:12345-0@lo:13: 00002000:00000024:3.0:1788725807.227855:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725807.227908:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791417856:12345-0@lo:13: Request processed in 87us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725807.227915:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788725807.228016:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f1180 x1875614791417856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725807.228027:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788725807.228045:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791417856:0@lo:13: 00000100:00080000:1.0:1788725807.228082:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725807.228872:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725807.228885:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791417984:0@lo:13: 00000100:00100000:0.0:1788725807.228930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725807.229049:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791417984 00000100:00100000:3.0:1788725807.229055:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791417984 00000100:00100000:3.0:1788725807.229106:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788725807.229134:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791417984:12345-0@lo:13: 00002000:00000024:3.0:1788725807.229150:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725807.229198:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791417984:12345-0@lo:13: Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725807.229206:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788725807.229240:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e74bb80 x1875614791417984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725807.229250:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788725807.229265:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791417984:0@lo:13: 00000100:00080000:2.0:1788725807.230895:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725807.231271:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791418240:0@lo:400: 00000100:00100000:1.0:1788725807.231327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231356:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791418752:0@lo:400: 00000100:00100000:1.0:1788725807.231390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231407:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791419264:0@lo:400: 00000100:00100000:1.0:1788725807.231428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231458:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788725807.231464:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791418368:0@lo:400: 00000100:00100000:1.0:1788725807.231487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231504:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791418880:0@lo:400: 00000100:00100000:1.0:1788725807.231524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231538:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791419392:0@lo:400: 00000100:00100000:1.0:1788725807.231557:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725807.231579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418240 00000100:00100000:1.0:1788725807.231586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418240 00000100:00100000:1.0:1788725807.231620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418752 00000100:00100000:1.0:1788725807.231623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418752 00000100:00100000:1.0:1788725807.231656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419264 00000100:00100000:1.0:1788725807.231659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419264 00000100:00100000:1.0:1788725807.231671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418880 00000100:00100000:1.0:1788725807.231673:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418880 00000100:00100000:1.0:1788725807.231684:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419392 00000100:00100000:1.0:1788725807.231686:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419392 00000100:00100000:1.0:1788725807.231700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725807.231707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791418240:12345-0@lo:400: 00000100:00100000:1.0:1788725807.231752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791418240:12345-0@lo:400: Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.231769:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725807.231786:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725807.231792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791418752:12345-0@lo:400: 00000100:00100000:1.0:1788725807.231821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791418752:12345-0@lo:400: Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.231826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725807.231837:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788725807.231842:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791419264:12345-0@lo:400: 00000100:00100000:1.0:1788725807.231865:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791419264:12345-0@lo:400: Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.231871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788725807.231880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725807.231885:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791418880:12345-0@lo:400: 00000100:00100000:1.0:1788725807.231906:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791418880:12345-0@lo:400: Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.231911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725807.231919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788725807.231924:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791419392:12345-0@lo:400: 00000100:00100000:1.0:1788725807.231948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791419392:12345-0@lo:400: Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.231953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788725807.231976:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418368 00000100:00100000:1.0:1788725807.231979:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418368 00000100:00100000:1.0:1788725807.232003:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725807.232009:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791418368:12345-0@lo:400: 00000100:00100000:1.0:1788725807.232047:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791418368:12345-0@lo:400: Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.232054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725807.232086:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791418368:0@lo:400: 00010000:00080000:1.0:1788725807.232098:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0e00 x1875614791418880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725807.232107:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791418880:0@lo:400: 00010000:00080000:1.0:1788725807.232136:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a6300 x1875614791419392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725807.232145:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791419392:0@lo:400: 00010000:00080000:1.0:1788725807.232153:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f2a00 x1875614791418240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725807.232161:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791418240:0@lo:400: 00010000:00080000:1.0:1788725807.232168:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f2680 x1875614791418752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725807.232175:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791418752:0@lo:400: 00010000:00080000:1.0:1788725807.232182:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a7b80 x1875614791419264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725807.232189:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791419264:0@lo:400: 00000100:00080000:2.0:1788725807.232414:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725807.232418:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725807.232429:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791418112:0@lo:400: 00000100:00100000:2.0:1788725807.232461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725807.232493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791418624:0@lo:400: 00000100:00100000:2.0:1788725807.232521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725807.232537:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791419136:0@lo:400: 00000100:00100000:2.0:1788725807.232557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725807.232573:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788725807.232578:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791418496:0@lo:400: 00000100:00100000:2.0:1788725807.232596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725807.232609:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791419008:0@lo:400: 00000100:00100000:2.0:1788725807.232636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725807.232661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418624 00000100:00100000:2.0:1788725807.232665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418624 00000100:00100000:2.0:1788725807.232686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788725807.232692:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791418624:12345-0@lo:400: 00000100:00100000:2.0:1788725807.232724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791418624:12345-0@lo:400: Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725807.232729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788725807.232745:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419136 00000100:00100000:2.0:1788725807.232748:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419136 00000100:00100000:2.0:1788725807.232770:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419008 00000100:00100000:2.0:1788725807.232772:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419008 00000100:00100000:2.0:1788725807.232787:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788725807.232792:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791419136:12345-0@lo:400: 00000100:00100000:2.0:1788725807.232821:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791419136:12345-0@lo:400: Request processed in 28us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725807.232827:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788725807.232835:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788725807.232840:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791419008:12345-0@lo:400: 00000100:00100000:2.0:1788725807.232861:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791419008:12345-0@lo:400: Request processed in 21us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725807.232872:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788725807.232891:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725807.232909:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f1500 x1875614791419008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725807.232918:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791419008:0@lo:400: 00000100:00100000:2.0:1788725807.232926:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791418624:0@lo:400: 00010000:00080000:2.0:1788725807.232934:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a6680 x1875614791419136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725807.232941:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791419136:0@lo:400: 00000100:00100000:2.0:1788725807.232973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418496 00000100:00100000:2.0:1788725807.232976:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418496 00000100:00100000:2.0:1788725807.232996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788725807.233001:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791418496:12345-0@lo:400: 00000100:00100000:2.0:1788725807.233032:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791418496:12345-0@lo:400: Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725807.233037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788725807.233060:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f3480 x1875614791418496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725807.233068:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791418496:0@lo:400: 00000100:00100000:1.0:1788725807.234810:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791418112 00000100:00100000:1.0:1788725807.234823:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791418112 00000100:00100000:1.0:1788725807.234867:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788725807.234876:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791418112:12345-0@lo:400: 00000100:00100000:1.0:1788725807.235020:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791418112:12345-0@lo:400: Request processed in 145us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725807.235028:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788725807.235250:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791418112:0@lo:400: 00010000:00010000:1.0:1788725808.017928:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788725808.190507:0:10077:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788725808.190521:0:10077:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788725808.251505:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791419520:0@lo:41: 00000100:00100000:3.0:1788725808.251567:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725808.251654:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419520 00000100:00100000:2.0:1788725808.251663:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419520 00000100:00100000:2.0:1788725808.251710:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788725808.251720:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791419520:12345-0@lo:41: 00000004:00000024:2.0:1788725808.251760:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725808.258061:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791419520:12345-0@lo:41: Request processed in 6334us (6485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725808.258075:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788725808.258223:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791419520:0@lo:41: 00010000:00010000:0.0:1788725809.020065:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725809.725517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.725748:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770397568 00000100:00100000:2.0:1788725809.725759:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770397568 00000100:00100000:2.0:1788725809.725804:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:2.0:1788725809.725813:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1875614770397568:12345-192.168.203.12@tcp:250: 00010000:00080000:2.0:1788725809.725840:0:6506:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b74862ab-5cca-4993-81bc-e5d26377a66b@192.168.203.12@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:2.0:1788725809.725877:0:6506:0:(genops.c:1385:class_connect()) connect: client b74862ab-5cca-4993-81bc-e5d26377a66b, cookie 0xa13c582691d36dfa 00000100:00080000:2.0:1788725809.726338:0:6506:0:(import.c:65:import_set_state_nolock()) ffff9b12834b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725809.726422:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+5:2394:x1875614770397568:12345-192.168.203.12@tcp:250: Request processed in 607us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.726430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1788725809.733370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.734482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770397440 00000100:00100000:2.0:1788725809.734495:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770397440 00000100:00100000:2.0:1788725809.734601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:2.0:1788725809.734613:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+5:6154:x1875614770397440:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788725809.734628:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725809.734647:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6c4b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.734674:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.734686:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.734724:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fc00, rc 0) 00000100:00100000:2.0:1788725809.734792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+6:6154:x1875614770397440:12345-192.168.203.12@tcp:101: Request processed in 180us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.734798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788725809.738781:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725809.745587:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770397696 00000100:00100000:1.0:1788725809.745602:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770397696 00000100:00100000:1.0:1788725809.745671:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1788725809.745682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+6:6154:x1875614770397696:12345-192.168.203.12@tcp:501: 00000100:00100000:1.0:1788725809.745820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+6:6154:x1875614770397696:12345-192.168.203.12@tcp:501: Request processed in 139us (7048us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725809.745828:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:3.0:1788725809.750033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725809.750186:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770397824 00000100:00100000:1.0:1788725809.750201:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770397824 00000100:00100000:1.0:1788725809.750270:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1788725809.750281:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+6:6154:x1875614770397824:12345-192.168.203.12@tcp:101: 00010000:00010000:1.0:1788725809.750298:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725809.750317:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6c52 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725809.750344:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725809.750366:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725809.750376:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ba00, rc 0) 00000100:00100000:1.0:1788725809.750460:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+7:6154:x1875614770397824:12345-192.168.203.12@tcp:101: Request processed in 180us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725809.750468:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:3.0:1788725809.754112:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725809.759485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770397952 00000100:00100000:0.0:1788725809.759507:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770397952 00000100:00100000:0.0:1788725809.759592:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:0.0:1788725809.759605:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+7:6154:x1875614770397952:12345-192.168.203.12@tcp:501: 00000100:00100000:0.0:1788725809.759856:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6154:x1875614770397952:12345-192.168.203.12@tcp:501: Request processed in 252us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725809.759865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:3.0:1788725809.770249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.770619:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398080 00000100:00100000:2.0:1788725809.770633:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398080 00000100:00100000:2.0:1788725809.770716:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:2.0:1788725809.770729:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6154:x1875614770398080:12345-192.168.203.12@tcp:503: 00000100:00100000:2.0:1788725809.770933:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6154:x1875614770398080:12345-192.168.203.12@tcp:503: Request processed in 207us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.770942:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:3.0:1788725809.782806:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725809.783178:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398208 00000100:00100000:1.0:1788725809.783192:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398208 00000100:00100000:1.0:1788725809.783274:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1788725809.783287:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6173:x1875614770398208:12345-192.168.203.12@tcp:502: 00000100:00100000:1.0:1788725809.783501:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6173:x1875614770398208:12345-192.168.203.12@tcp:502: Request processed in 215us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725809.783510:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:0.0:1788725809.789234:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791419648:0@lo:41: 00000100:00100000:0.0:1788725809.789332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725809.789517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419648 00000100:00100000:2.0:1788725809.789528:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419648 00000100:00100000:2.0:1788725809.789591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788725809.789602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791419648:12345-0@lo:41: 00000004:00000024:2.0:1788725809.789649:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788725809.789722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791419648:12345-0@lo:41: Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.789730:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788725809.790093:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791419648:0@lo:41: 00000100:00100000:3.0:1788725809.845799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725809.845940:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398336 00000100:00100000:0.0:1788725809.845954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398336 00000100:00100000:0.0:1788725809.846031:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788725809.846045:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6173:x1875614770398336:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788725809.846334:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6173:x1875614770398336:12345-192.168.203.12@tcp:502: Request processed in 291us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725809.846345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:3.0:1788725809.849901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.850026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398464 00000100:00100000:2.0:1788725809.850040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398464 00000100:00100000:2.0:1788725809.850112:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788725809.850170:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6154:x1875614770398464:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788725809.850192:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725809.850214:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6c83 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.850269:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c83 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.850281:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c83 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.850292:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949ea00, rc 0) 00000100:00100000:2.0:1788725809.850372:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6154:x1875614770398464:12345-192.168.203.12@tcp:101: Request processed in 206us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.850380:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:1.0:1788725809.856615:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.856858:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398592 00000100:00100000:2.0:1788725809.856873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398592 00000100:00100000:2.0:1788725809.856988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1788725809.857001:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6154:x1875614770398592:12345-192.168.203.12@tcp:256: 20000000:01000000:2.0:1788725809.857036:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788725809.857069:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788725809.857075:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788725809.857078:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788725809.857082:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788725809.857084:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788725809.860457:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6154:x1875614770398592:12345-192.168.203.12@tcp:256: Request processed in 3441us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.860476:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:0.0:1788725809.867531:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.867745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398720 00000100:00100000:2.0:1788725809.867759:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398720 00000100:00100000:2.0:1788725809.868636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:2.0:1788725809.868655:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6154:x1875614770398720:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788725809.868697:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725809.868739:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6c8a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.868779:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.868793:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 10 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725809.868804:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658400, rc 0) 00000100:00100000:2.0:1788725809.869475:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6154:x1875614770398720:12345-192.168.203.12@tcp:101: Request processed in 819us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.869484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:1.0:1788725809.872179:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.872290:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398848 00000100:00100000:2.0:1788725809.872303:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398848 00000100:00100000:2.0:1788725809.872428:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1788725809.872441:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6154:x1875614770398848:12345-192.168.203.12@tcp:501: 00000100:00100000:2.0:1788725809.872648:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6154:x1875614770398848:12345-192.168.203.12@tcp:501: Request processed in 209us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.872657:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:3.0:1788725809.875732:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725809.875847:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770398976 00000100:00100000:0.0:1788725809.875860:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770398976 00000100:00100000:0.0:1788725809.875945:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1788725809.875958:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6154:x1875614770398976:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1788725809.876188:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6154:x1875614770398976:12345-192.168.203.12@tcp:503: Request processed in 232us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725809.876197:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:3.0:1788725809.882953:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725809.883252:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399104 00000100:00100000:0.0:1788725809.883267:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399104 00000100:00100000:0.0:1788725809.883346:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1788725809.883369:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6180:x1875614770399104:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788725809.883808:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6180:x1875614770399104:12345-192.168.203.12@tcp:502: Request processed in 449us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725809.883817:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:3.0:1788725809.890755:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725809.890880:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399232 00000100:00100000:2.0:1788725809.890902:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399232 00000100:00100000:2.0:1788725809.890972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788725809.890984:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6180:x1875614770399232:12345-192.168.203.12@tcp:502: 00000100:00100000:2.0:1788725809.891270:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6180:x1875614770399232:12345-192.168.203.12@tcp:502: Request processed in 286us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725809.891289:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:3.0:1788725809.896173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725809.896265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725809.896592:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399360 00000100:00100000:1.0:1788725809.896606:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399360 00000100:00100000:1.0:1788725809.896659:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399616 00000100:00100000:1.0:1788725809.896663:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399616 00000100:00100000:1.0:1788725809.896685:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788725809.896697:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875614770399360:12345-192.168.203.12@tcp:38: 00010000:00080000:1.0:1788725809.896736:0:9522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1788725809.896801:0:9522:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d36e1d 00000004:00100000:1.0:1788725809.896833:0:9522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788725809.897163:0:9522:0:(import.c:65:import_set_state_nolock()) ffff9b139e73b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725809.897264:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770399360:12345-192.168.203.12@tcp:38: Request processed in 567us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725809.897275:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788725809.897301:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788725809.897306:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875614770399616:12345-192.168.203.12@tcp:38: 00010000:00080000:1.0:1788725809.897339:0:9522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1788725809.897387:0:9522:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d36e24 00000004:00100000:1.0:1788725809.897402:0:9522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788725809.897557:0:9522:0:(import.c:65:import_set_state_nolock()) ffff9b139e73e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788725809.897586:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770399616:12345-192.168.203.12@tcp:38: Request processed in 278us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725809.897594:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:3.0:1788725810.046896:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725810.299541:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791419776:0@lo:13: 00000100:00100000:1.0:1788725810.299643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725810.300701:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419776 00000100:00100000:0.0:1788725810.300717:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419776 00000100:00100000:0.0:1788725810.300877:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788725810.300892:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791419776:12345-0@lo:13: 00002000:00000024:0.0:1788725810.300933:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725810.301008:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791419776:12345-0@lo:13: Request processed in 122us (1367us total) trans 0 rc 0/0 00010000:00080000:1.0:1788725810.301177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833dbb80 x1875614791419776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725810.301201:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791419776:0@lo:13: 00000100:00080000:2.0:1788725810.301635:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725810.301839:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788725810.302155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725810.302173:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791419904:0@lo:13: 00000100:00100000:1.0:1788725810.302237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725810.302313:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791419904 00000100:00100000:1.0:1788725810.302326:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791419904 00000100:00100000:1.0:1788725810.302386:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788725810.302396:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791419904:12345-0@lo:13: 00000100:00080000:2.0:1788725810.302840:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788725810.304262:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725810.304383:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791419904:12345-0@lo:13: Request processed in 1981us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725810.304395:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788725810.304416:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a4a80 x1875614791419904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725810.304444:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791419904:0@lo:13: 00000100:00100000:0.0:1788725810.908470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725810.908517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725810.908624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725810.908742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399488 00000100:00100000:2.0:1788725810.908756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399488 00000100:00100000:2.0:1788725810.908846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399872 00000100:00100000:2.0:1788725810.908850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399872 00000100:00100000:2.0:1788725810.908864:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770399744 00000100:00100000:2.0:1788725810.908866:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770399744 00000100:00100000:2.0:1788725810.908889:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788725810.908900:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:0:x1875614770399488:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1788725810.908964:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788725810.909047:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:0:x1875614770399488:12345-192.168.203.12@tcp:41: Request processed in 147us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.909055:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788725810.909077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788725810.909084:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770399872:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1788725810.909095:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788725810.909153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770399872:12345-192.168.203.12@tcp:41: Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.909161:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788725810.909176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:2.0:1788725810.909183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:0:x1875614770399744:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1788725810.909232:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725810.909261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:0:x1875614770399744:12345-192.168.203.12@tcp:41: Request processed in 78us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.909275:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00080000:0.0:1788725810.909493:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725810.909498:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725810.912660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725810.912925:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400000 00000100:00100000:3.0:1788725810.912938:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400000 00000100:00100000:3.0:1788725810.913010:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788725810.913022:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400000:12345-192.168.203.12@tcp:40: 00000100:00100000:3.0:1788725810.913166:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400000:12345-192.168.203.12@tcp:40: Request processed in 146us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725810.913175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788725810.917053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725810.917255:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400128 00000100:00100000:2.0:1788725810.917269:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400128 00000100:00100000:2.0:1788725810.917334:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788725810.917344:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770400128:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1788725810.917399:0:8716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1788725810.917441:0:8716:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d36e2b 00002000:00100000:2.0:1788725810.917456:0:8716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78ae299a-14d0-4856-aa24-442bf24804dd/ffff9b12834b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725810.917471:0:8716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725810.917809:0:8716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788725810.917849:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b12834b2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725810.918058:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770400128:12345-192.168.203.12@tcp:8: Request processed in 712us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.918067:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788725810.924865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725810.924979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725810.925086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400512 00000100:00100000:3.0:1788725810.925098:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400512 00000100:00100000:3.0:1788725810.925208:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788725810.925221:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400512:12345-192.168.203.12@tcp:900: 00000100:00100000:3.0:1788725810.925333:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400512:12345-192.168.203.12@tcp:900: Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725810.925369:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788725810.925731:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400256 00000100:00100000:2.0:1788725810.925736:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400256 00000100:00100000:2.0:1788725810.925778:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:2.0:1788725810.925787:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2395:x1875614770400256:12345-192.168.203.12@tcp:400: 00000100:00100000:2.0:1788725810.925824:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2395:x1875614770400256:12345-192.168.203.12@tcp:400: Request processed in 38us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.925831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:0.0:1788725810.929847:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725810.930241:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400384 00000100:00100000:2.0:1788725810.930254:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400384 00000100:00100000:2.0:1788725810.930318:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788725810.930329:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875614770400384:12345-192.168.203.12@tcp:8: 00010000:00080000:2.0:1788725810.930405:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1788725810.930445:0:8425:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d36e32 00002000:00100000:2.0:1788725810.930460:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78ae299a-14d0-4856-aa24-442bf24804dd/ffff9b12834b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725810.930488:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725810.931283:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725810.931331:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b12834b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725810.931436:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770400384:12345-192.168.203.12@tcp:8: Request processed in 1106us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725810.931447:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788725810.931909:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725810.932316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400640 00000100:00100000:3.0:1788725810.932327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400640 00000100:00100000:3.0:1788725810.932396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788725810.932408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400640:12345-192.168.203.12@tcp:33: 00000004:00080000:3.0:1788725810.952690:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20182us 00000004:00200000:3.0:1788725810.977436:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788725810.977682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:6154:x1875614770400640:12345-192.168.203.12@tcp:33: Request processed in 45268us (45767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725810.977694:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00010000:00010000:1.0:1788725811.067417:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725811.227627:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725811.227717:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400768 00000100:00100000:2.0:1788725811.227729:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400768 00000100:00100000:2.0:1788725811.227815:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788725811.227837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:6198:x1875614770400768:12345-192.168.203.12@tcp:101: 00010000:00010000:2.0:1788725811.227863:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725811.229737:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658200/0xa13c582691d36e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6cbb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.229819:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.229832:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.229847:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725811.229897:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788725811.229912:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725811.229931:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.230172:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658200/0xa13c582691d36e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cbb expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.230194:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cbb expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725811.230204:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455800) 00010000:00010000:2.0:1788725811.230207:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788725811.230210:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725811.230287:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:6198:x1875614770400768:12345-192.168.203.12@tcp:101: Request processed in 2452us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725811.230295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:0.0:1788725812.093492:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725812.347576:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791420032:0@lo:400: 00000100:00100000:2.0:1788725812.347591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791420288:0@lo:400: 00000100:00100000:2.0:1788725812.347674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.347694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791420416:0@lo:400: 00000100:00100000:2.0:1788725812.347751:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791420800:0@lo:400: 00000100:00100000:3.0:1788725812.348231:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791420160:0@lo:13: 00000100:00100000:0.0:1788725812.350319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.350419:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791420928:0@lo:400: 00000100:00100000:0.0:1788725812.350456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.350479:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791421440:0@lo:400: 00000100:00100000:0.0:1788725812.350503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725812.350527:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.350539:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725812.350550:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791421824:0@lo:13: 00000100:00100000:1.0:1788725812.350616:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791420544:0@lo:400: 00000100:00100000:0.0:1788725812.350689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.350808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420288 00000100:00100000:0.0:1788725812.350819:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420288 00000100:00100000:2.0:1788725812.350952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725812.350980:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791421312:0@lo:400: 00000100:00100000:2.0:1788725812.351004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725812.351272:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420928 00000100:00100000:0.0:1788725812.351278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420928 00000100:00100000:0.0:1788725812.351565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421440 00000100:00100000:0.0:1788725812.352708:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421440 00000100:00100000:1.0:1788725812.352720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725812.352754:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791421056:0@lo:400: 00000100:00100000:1.0:1788725812.352782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725812.352807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791421568:0@lo:400: 00000100:00100000:1.0:1788725812.352827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725812.352881:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420800 00000100:00100000:1.0:1788725812.352888:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420800 00000100:00100000:1.0:1788725812.352924:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421312 00000100:00100000:1.0:1788725812.352927:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421312 00000100:00100000:1.0:1788725812.352938:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420544 00000100:00100000:1.0:1788725812.352940:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420544 00000100:00100000:1.0:1788725812.352969:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725812.352981:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791420288:12345-0@lo:400: 00000100:00100000:0.0:1788725812.353008:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788725812.353024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791420928:12345-0@lo:400: 00000100:00100000:1.0:1788725812.353041:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791420288:12345-0@lo:400: Request processed in 61us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.353057:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725812.353085:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725812.353094:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791420800:12345-0@lo:400: 00000100:00100000:0.0:1788725812.353171:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791420928:12345-0@lo:400: Request processed in 151us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.353184:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791420800:12345-0@lo:400: Request processed in 85us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725812.353187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725812.353202:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788725812.353219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788725812.353235:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788725812.353237:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791421312:12345-0@lo:400: 00000100:00100000:1.0:1788725812.353252:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791420544:12345-0@lo:400: 00000100:00100000:0.0:1788725812.353290:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791421312:12345-0@lo:400: Request processed in 61us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725812.353298:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788725812.353320:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788725812.353330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791421440:12345-0@lo:400: 00000100:00100000:1.0:1788725812.353350:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791420544:12345-0@lo:400: Request processed in 91us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.353367:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788725812.353371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420416 00000100:00100000:2.0:1788725812.353379:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420416 00000100:00100000:0.0:1788725812.353393:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791421440:12345-0@lo:400: Request processed in 64us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.353400:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421056 00000100:00100000:0.0:1788725812.353404:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788725812.353408:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421056 00000100:00100000:2.0:1788725812.353430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788725812.353444:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791420416:12345-0@lo:400: 00000100:00100000:0.0:1788725812.353446:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421824 00000100:00100000:1.0:1788725812.353454:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421568 00000100:00100000:0.0:1788725812.353455:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421824 00000100:00100000:1.0:1788725812.353461:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421568 00000100:00100000:1.0:1788725812.353511:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788725812.353513:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791420416:12345-0@lo:400: Request processed in 73us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725812.353517:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725812.353525:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791421056:12345-0@lo:400: 00000100:00100000:0.0:1788725812.353533:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875614791421824:12345-0@lo:13: 00000100:00100000:2.0:1788725812.353536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00002000:00000024:0.0:1788725812.353563:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725812.353610:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791420800:0@lo:400: 00000100:00100000:0.0:1788725812.353632:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1875614791421824:12345-0@lo:13: Request processed in 104us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725812.353641:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791421312:0@lo:400: 00000100:00100000:0.0:1788725812.353647:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788725812.353680:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725812.353686:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725812.353689:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725812.353693:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725812.353695:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791420288:0@lo:400: 00010000:00080000:0.0:1788725812.353746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b7480 x1875614791421824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725812.353784:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791421824:0@lo:13: 00000100:00100000:0.0:1788725812.353808:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791420416:0@lo:400: 00000100:00100000:1.0:1788725812.353818:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791421056:12345-0@lo:400: Request processed in 292us (1027us total) trans 0 rc 0/0 00010000:00080000:0.0:1788725812.353828:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be826a00 x1875614791420928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725812.353829:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788725812.353847:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791420928:0@lo:400: 00000100:00100000:1.0:1788725812.353868:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788725812.353877:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791421568:12345-0@lo:400: 00010000:00080000:0.0:1788725812.353882:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be825180 x1875614791421440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725812.353896:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791421440:0@lo:400: 00000100:00100000:1.0:1788725812.353932:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791421568:12345-0@lo:400: Request processed in 54us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.353941:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788725812.353984:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420032 00000100:00100000:0.0:1788725812.353991:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420032 00000100:00100000:0.0:1788725812.354031:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788725812.354040:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791420032:12345-0@lo:400: 00000100:00100000:1.0:1788725812.354073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791420544:0@lo:400: 00010000:00080000:1.0:1788725812.354088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827800 x1875614791421056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725812.354098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791421056:0@lo:400: 00010000:00080000:1.0:1788725812.354108:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827480 x1875614791421568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725812.354138:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791421568:0@lo:400: 00000100:00100000:0.0:1788725812.354369:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791420032:12345-0@lo:400: Request processed in 328us (3847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725812.354378:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788725812.354685:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791420032:0@lo:400: 00000100:00100000:3.0:1788725812.354819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725812.354872:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791420672:0@lo:400: 00000100:00100000:3.0:1788725812.354907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725812.354945:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791421184:0@lo:400: 00000100:00100000:3.0:1788725812.354968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725812.354994:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421184 00000100:00100000:3.0:1788725812.355000:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421184 00000100:00100000:1.0:1788725812.355029:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420160 00000100:00100000:2.0:1788725812.355045:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791420672 00000100:00100000:1.0:1788725812.355045:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420160 00000100:00100000:2.0:1788725812.355056:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791420672 00000100:00100000:1.0:1788725812.355088:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725812.355102:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791420160:12345-0@lo:13: 00000100:00100000:2.0:1788725812.355148:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00002000:00000024:1.0:1788725812.355152:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725812.355164:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791420672:12345-0@lo:400: 00000100:00100000:1.0:1788725812.355200:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791420160:12345-0@lo:13: Request processed in 100us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.355210:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788725812.355244:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788725812.355247:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791420672:12345-0@lo:400: Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725812.355258:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791421184:12345-0@lo:400: 00000100:00100000:2.0:1788725812.355271:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788725812.355310:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791421184:12345-0@lo:400: Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725812.355318:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788725812.355356:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be824e00 x1875614791421184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725812.355369:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791421184:0@lo:400: 00000100:00100000:2.0:1788725812.355379:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791421696:0@lo:400: 00000100:00100000:2.0:1788725812.355416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788725812.355451:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725812.355458:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725812.355475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833da300 x1875614791420160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725812.355495:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791420160:0@lo:13: 00000100:00100000:1.0:1788725812.355510:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421696 00000100:00100000:2.0:1788725812.355517:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791420672:0@lo:400: 00000100:00100000:1.0:1788725812.355520:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421696 00000100:00100000:1.0:1788725812.355582:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788725812.355591:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791421696:12345-0@lo:400: 00000100:00100000:1.0:1788725812.355651:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791421696:12345-0@lo:400: Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725812.355658:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788725812.359713:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be826680 x1875614791421696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725812.359732:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791421696:0@lo:400: 00010000:00010000:3.0:1788725813.115589:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725813.371802:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791421952:0@lo:41: 00000100:00100000:0.0:1788725813.371873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725813.372189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791421952 00000100:00100000:3.0:1788725813.372209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791421952 00000100:00100000:3.0:1788725813.372273:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788725813.372283:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791421952:12345-0@lo:41: 00000004:00000024:3.0:1788725813.372549:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725813.372618:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791421952:12345-0@lo:41: Request processed in 336us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725813.372625:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788725813.372789:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791421952:0@lo:41: 00000100:00100000:1.0:1788725813.537389:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725813.537555:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770400896 00000100:00100000:2.0:1788725813.537565:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770400896 00000100:00100000:2.0:1788725813.537644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788725813.537655:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:6250:x1875614770400896:12345-192.168.203.12@tcp:41: 00000004:00000024:2.0:1788725813.537693:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1788725813.537811:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725813.541975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:6250:x1875614770400896:12345-192.168.203.12@tcp:41: Request processed in 4304us (4577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725813.541988:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788725813.548941:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725813.549038:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401024 00000100:00100000:0.0:1788725813.549047:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401024 00000100:00100000:0.0:1788725813.549154:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788725813.549165:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401024:12345-192.168.203.12@tcp:41: 00000004:00000024:0.0:1788725813.549204:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725813.549273:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401024:12345-192.168.203.12@tcp:41: Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725813.549280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:2.0:1788725813.550646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725813.557418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725813.559143:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401152 00000100:00100000:1.0:1788725813.559156:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401152 00000100:00100000:1.0:1788725813.559264:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788725813.559276:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401152:12345-192.168.203.12@tcp:13: 00002000:00000024:1.0:1788725813.559317:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725813.559399:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401152:12345-192.168.203.12@tcp:13: Request processed in 126us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725813.559407:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00080000:2.0:1788725813.559546:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725813.567514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725813.567868:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401280 00000100:00100000:0.0:1788725813.567877:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401280 00000100:00100000:0.0:1788725813.567939:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788725813.567950:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401280:12345-192.168.203.12@tcp:13: 00002000:00000024:0.0:1788725813.567984:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725813.568046:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:78ae299a-14d0-4856-aa24-442bf24804dd+6:6250:x1875614770401280:12345-192.168.203.12@tcp:13: Request processed in 98us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725813.568053:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00080000:2.0:1788725813.568153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788725813.899542:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00010000:00010000:1.0:1788725814.140308:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725814.907971:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725814.913689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791422080:0@lo:41: 00000100:00100000:2.0:1788725814.913872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725814.913993:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422080 00000100:00100000:0.0:1788725814.914006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422080 00000100:00100000:0.0:1788725814.914068:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788725814.914079:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791422080:12345-0@lo:41: 00000004:00000024:0.0:1788725814.914145:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788725814.914219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791422080:12345-0@lo:41: Request processed in 141us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725814.914226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725814.915699:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791422080:0@lo:41: 00010000:00010000:0.0:1788725815.163467:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725815.419868:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725815.419902:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791422208:0@lo:13: 00000100:00100000:1.0:1788725815.419989:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725815.420066:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422208 00000100:00100000:1.0:1788725815.420075:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422208 00000100:00100000:1.0:1788725815.420156:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788725815.420169:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791422208:12345-0@lo:13: 00002000:00000024:1.0:1788725815.420205:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725815.420255:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791422208:12345-0@lo:13: Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725815.420263:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788725815.420287:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725815.420331:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a7480 x1875614791422208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725815.420353:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791422208:0@lo:13: 00000100:00100000:0.0:1788725815.421366:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725815.425970:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791422336:0@lo:13: 00000100:00100000:0.0:1788725815.426067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725815.427968:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422336 00000100:00100000:1.0:1788725815.427987:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422336 00000100:00100000:1.0:1788725815.428081:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788725815.428093:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791422336:12345-0@lo:13: 00002000:00000024:1.0:1788725815.428142:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725815.431482:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791422336:12345-0@lo:13: Request processed in 3378us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725815.431500:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788725815.431561:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725815.431986:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a7480 x1875614791422336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725815.432014:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791422336:0@lo:13: 00000001:00100000:1.0:1788725815.944032:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000001:00100000:2.0:1788725815.944536:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000100:00100000:0.0:1788725815.996975:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725815.997035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725815.997055:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401536 00000100:00100000:3.0:1788725815.997068:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401536 00000100:00100000:0.0:1788725815.997133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725815.997156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725815.997171:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401664 00000100:00100000:3.0:1788725815.997175:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401664 00000100:00100000:0.0:1788725815.997192:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725815.997207:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788725815.997218:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770401536:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788725815.997330:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770401536:12345-192.168.203.12@tcp:400: Request processed in 114us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725815.997339:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788725815.997357:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788725815.997364:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770401664:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788725815.997388:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770401664:12345-192.168.203.12@tcp:400: Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725815.997393:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00080000:3.0:1788725815.997410:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725815.997415:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725815.998149:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401408 00000100:00100000:3.0:1788725815.998757:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401408 00000100:00100000:3.0:1788725815.998820:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1788725815.998837:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770401408:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788725815.999441:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770401408:12345-192.168.203.12@tcp:400: Request processed in 603us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725815.999451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1788725816.002446:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401792 00000100:00100000:1.0:1788725816.002446:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770401920 00000100:00100000:2.0:1788725816.002463:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401792 00000100:00100000:1.0:1788725816.002463:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770401920 00000100:00100000:2.0:1788725816.002570:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788725816.002583:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770401792:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788725816.002686:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788725816.002696:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770401920:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788725816.002727:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770401920:12345-192.168.203.12@tcp:400: Request processed in 33us (5534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725816.002735:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00080000:3.0:1788725816.002810:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725816.002816:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725816.004333:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770401792:12345-192.168.203.12@tcp:400: Request processed in 1733us (7277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725816.004349:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00010000:00010000:3.0:1788725816.187295:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725816.251642:0:10175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788725816.963335:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00010000:00010000:1.0:1788725817.211568:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725817.467492:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791422464:0@lo:13: 00000100:00100000:1.0:1788725817.467593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725817.467776:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422464 00000100:00100000:2.0:1788725817.467787:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422464 00000100:00100000:2.0:1788725817.467860:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725817.467872:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791422464:12345-0@lo:13: 00002000:00000024:2.0:1788725817.467919:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725817.467973:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791422464:12345-0@lo:13: Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725817.467980:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788725817.468809:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788725817.468865:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d8380 x1875614791422464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725817.468893:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791422464:0@lo:13: 00000100:00100000:1.0:1788725817.474413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791422592:0@lo:13: 00000100:00100000:1.0:1788725817.474503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.474579:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422592 00000100:00100000:1.0:1788725817.474588:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422592 00000100:00100000:1.0:1788725817.474653:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788725817.474664:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791422592:12345-0@lo:13: 00002000:00000024:1.0:1788725817.474690:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725817.474740:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791422592:12345-0@lo:13: Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725817.474748:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788725817.474789:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788725817.474821:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a7b80 x1875614791422592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725817.474842:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791422592:0@lo:13: 00000100:00100000:0.0:1788725817.483561:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791422848:0@lo:400: 00000100:00100000:0.0:1788725817.483654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483710:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791423360:0@lo:400: 00000100:00100000:0.0:1788725817.483733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483756:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791423872:0@lo:400: 00000100:00100000:0.0:1788725817.483781:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483813:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788725817.483819:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791422976:0@lo:400: 00000100:00100000:0.0:1788725817.483847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483865:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791423488:0@lo:400: 00000100:00100000:0.0:1788725817.483886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483903:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791424000:0@lo:400: 00000100:00100000:0.0:1788725817.483923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725817.483947:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422848 00000100:00100000:0.0:1788725817.483956:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422848 00000100:00100000:0.0:1788725817.484000:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423360 00000100:00100000:0.0:1788725817.484002:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423360 00000100:00100000:0.0:1788725817.484024:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423872 00000100:00100000:0.0:1788725817.484026:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423872 00000100:00100000:0.0:1788725817.484038:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423488 00000100:00100000:0.0:1788725817.484040:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423488 00000100:00100000:0.0:1788725817.484064:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424000 00000100:00100000:0.0:1788725817.484067:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424000 00000100:00100000:0.0:1788725817.484083:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788725817.484098:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791422848:12345-0@lo:400: 00000100:00100000:0.0:1788725817.484184:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791422848:12345-0@lo:400: Request processed in 87us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.484192:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788725817.484375:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791422720:0@lo:400: 00000100:00100000:1.0:1788725817.484413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.484437:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791423232:0@lo:400: 00000100:00100000:1.0:1788725817.484459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.484474:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791423744:0@lo:400: 00000100:00100000:1.0:1788725817.484496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.484517:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788725817.484523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791423104:0@lo:400: 00000100:00100000:1.0:1788725817.484556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.484569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791423616:0@lo:400: 00000100:00100000:1.0:1788725817.484588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725817.484615:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423744 00000100:00100000:1.0:1788725817.484619:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423744 00000100:00100000:1.0:1788725817.484652:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423616 00000100:00100000:1.0:1788725817.484656:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423616 00000100:00100000:1.0:1788725817.484677:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725817.484685:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791423744:12345-0@lo:400: 00000100:00100000:1.0:1788725817.484723:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791423744:12345-0@lo:400: Request processed in 40us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725817.484729:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788725817.484744:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788725817.484749:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791423616:12345-0@lo:400: 00000100:00100000:1.0:1788725817.484788:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791423616:12345-0@lo:400: Request processed in 38us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725817.484794:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788725817.484840:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635500 x1875614791423616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725817.484855:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791423616:0@lo:400: 00010000:00080000:1.0:1788725817.484866:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635880 x1875614791423744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725817.484875:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791423744:0@lo:400: 00000100:00100000:2.0:1788725817.485400:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423104 00000100:00100000:2.0:1788725817.485408:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423104 00000100:00100000:2.0:1788725817.485439:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725817.485448:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791423360:12345-0@lo:400: 00000100:00100000:2.0:1788725817.485497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791423360:12345-0@lo:400: Request processed in 51us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725817.485504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725817.485518:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788725817.485524:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791423872:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486199:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788725817.486225:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791423488:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486452:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791423488:12345-0@lo:400: Request processed in 243us (2564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486460:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788725817.486477:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788725817.486485:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791424000:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486516:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791424000:12345-0@lo:400: Request processed in 32us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486522:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788725817.486534:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788725817.486540:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791423104:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486597:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791423104:12345-0@lo:400: Request processed in 57us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486603:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788725817.486635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422720 00000100:00100000:0.0:1788725817.486641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422720 00000100:00100000:0.0:1788725817.486681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788725817.486688:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791422720:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486721:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791422720:12345-0@lo:400: Request processed in 34us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788725817.486780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791422976 00000100:00100000:0.0:1788725817.486785:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791422976 00000100:00100000:0.0:1788725817.486808:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791423232 00000100:00100000:0.0:1788725817.486813:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791423232 00000100:00100000:0.0:1788725817.486826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788725817.486832:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791422976:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791422976:12345-0@lo:400: Request processed in 37us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486876:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788725817.486887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788725817.486892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791423232:12345-0@lo:400: 00000100:00100000:0.0:1788725817.486919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791423232:12345-0@lo:400: Request processed in 27us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725817.486924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788725817.486952:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725817.486959:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725817.486962:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725817.487111:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791422976:0@lo:400: 00010000:00080000:0.0:1788725817.487155:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7af100 x1875614791423488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725817.487166:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791423488:0@lo:400: 00010000:00080000:0.0:1788725817.487177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635c00 x1875614791424000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725817.487185:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791424000:0@lo:400: 00000100:00100000:0.0:1788725817.487198:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791422848:0@lo:400: 00000100:00100000:0.0:1788725817.487221:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791423360:0@lo:400: 00000100:00100000:0.0:1788725817.487247:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791423872:0@lo:400: 00000100:00100000:1.0:1788725817.489092:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791423104:0@lo:400: 00000100:00100000:1.0:1788725817.489111:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791422720:0@lo:400: 00000100:00100000:1.0:1788725817.489150:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791423232:0@lo:400: 00000100:00100000:2.0:1788725817.492565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791423872:12345-0@lo:400: Request processed in 7016us (8758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725817.492584:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:0.0:1788725818.238603:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725818.497145:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791424128:0@lo:41: 00000100:00100000:2.0:1788725818.497241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725818.497372:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424128 00000100:00100000:3.0:1788725818.497381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424128 00000100:00100000:3.0:1788725818.497456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788725818.497465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791424128:12345-0@lo:41: 00000004:00000024:3.0:1788725818.497505:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725818.502227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791424128:12345-0@lo:41: Request processed in 4747us (4971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725818.502246:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788725818.506672:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791424128:0@lo:41: 00010000:00010000:3.0:1788725819.266872:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725820.028785:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791424256:0@lo:41: 00000100:00100000:0.0:1788725820.028885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.029101:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424256 00000100:00100000:2.0:1788725820.029111:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424256 00000100:00100000:2.0:1788725820.029206:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788725820.029218:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791424256:12345-0@lo:41: 00000004:00000024:2.0:1788725820.029264:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788725820.029341:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791424256:12345-0@lo:41: Request processed in 125us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.029371:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788725820.029613:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791424256:0@lo:41: 00010000:00010000:1.0:1788725820.284491:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725820.541253:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791424512:0@lo:13: 00000100:00100000:0.0:1788725820.541253:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791424384:0@lo:13: 00000100:00100000:0.0:1788725820.546821:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725820.547003:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424384 00000100:00100000:1.0:1788725820.547016:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424384 00000100:00100000:1.0:1788725820.547097:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788725820.547111:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791424384:12345-0@lo:13: 00002000:00000024:1.0:1788725820.547173:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725820.547235:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791424384:12345-0@lo:13: Request processed in 127us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725820.547243:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788725820.547329:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725820.547370:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d9f80 x1875614791424384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725820.547394:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791424384:0@lo:13: 00000100:00100000:2.0:1788725820.547624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725820.547935:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424512 00000100:00100000:1.0:1788725820.547941:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424512 00000100:00100000:1.0:1788725820.548041:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788725820.548051:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791424512:12345-0@lo:13: 00002000:00000024:1.0:1788725820.548074:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725820.548141:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791424512:12345-0@lo:13: Request processed in 92us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725820.548150:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788725820.548184:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f1500 x1875614791424512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725820.548201:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791424512:0@lo:13: 00000100:00080000:0.0:1788725820.548263:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788725820.673969:0:10323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda47c0d80 20000000:00000080:2.0:1788725820.673993:0:10323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b139e6cb800 uarg=0000000000000000 20000000:01000000:2.0:1788725820.674047:0:10323:0:(mgs_llog.c:2009:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788725820.674050:0:10323:0:(mgs_llog.c:6072:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788725820.674054:0:10323:0:(mgs_llog.c:6103:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788725820.674060:0:10323:0:(mgs_llog.c:4751:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788725820.674066:0:10323:0:(mgs_llog.c:4184:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788725820.674242:0:10323:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788725820.674245:0:10323:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725820.675786:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788725820.676399:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788725820.676438:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788725820.676455:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788725820.676469:0:10323:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788725820.676471:0:10323:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725820.676853:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788725820.677018:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788725820.677039:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788725820.677054:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788725820.677062:0:10323:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788725820.677064:0:10323:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725820.677815:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788725820.677991:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788725820.678007:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788725820.678032:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788725820.678040:0:10323:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788725820.678042:0:10323:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725820.678480:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788725820.678778:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788725820.678803:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788725820.678816:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788725820.678825:0:10323:0:(mgs_llog.c:2553:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788725820.678833:0:10323:0:(mgs_llog.c:1112:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788725820.679320:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788725820.679412:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788725820.679433:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788725820.679447:0:10323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1788725820.679461:0:10323:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788725820.679487:0:10323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679509:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36cdb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679515:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d05 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679519:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d44 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679523:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d52 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679527:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d60 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679531:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d7c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679535:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36d9f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679539:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679552:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36dec expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679559:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679563:0:10323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679569:0:10323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679611:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679626:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 9 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.679639:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424640:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725820.679815:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679824:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 9 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.679831:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424768:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725820.679861:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679881:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 23 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.679891:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424896:0@lo:104: 00000100:00100000:2.0:1788725820.679943:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725820.679979:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.679987:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 23 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.679993:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425024:0@lo:104: 00000100:00100000:0.0:1788725820.679993:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791424896 00000100:00100000:0.0:1788725820.680002:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791424896 00000100:00100000:2.0:1788725820.680013:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725820.680044:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725820.680044:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425024 00000100:00100000:0.0:1788725820.680047:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425024 00010000:00010000:2.0:1788725820.680052:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680059:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425152:0@lo:104: 00000100:00100000:0.0:1788725820.680062:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788725820.680072:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:10323:x1875614791424896:12345-0@lo:104: 00000100:00100000:2.0:1788725820.680078:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788725820.680088:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.680181:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788725820.680189:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:10323:x1875614791424896:12345-0@lo:104: Request processed in 117us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1788725820.680204:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680213:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 23 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680220:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425280:0@lo:104: 00000100:00100000:2.0:1788725820.680253:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725820.680276:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680294:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680302:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425408:0@lo:104: 00010000:00010000:2.0:1788725820.680327:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680335:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 23 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725820.680335:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788725820.680343:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425536:0@lo:104: 00000100:00100000:1.0:1788725820.680354:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725820.680373:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788725820.680375:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725820.680379:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788725820.680391:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680398:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680406:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425664:0@lo:104: 00000100:00100000:2.0:1788725820.680425:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725820.680440:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680448:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680467:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425792:0@lo:104: 00000100:00100000:2.0:1788725820.680488:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725820.680505:0:10323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.680512:0:10323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 23 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680518:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788725820.680519:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425920:0@lo:104: 00010000:00010000:3.0:1788725820.680526:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680534:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a400 already unused, calling callback (ffffffffc1262c20) 00000100:00100000:2.0:1788725820.680536:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788725820.680538:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680546:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1788725820.680547:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725820.680563:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725820.680568:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788725820.680568:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424896:0@lo:104: 00010000:00010000:3.0:1788725820.680607:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680614:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725820.680637:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.680643:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791426048:0@lo:103: 00010000:00010000:3.0:1788725820.680644:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36dec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36df3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680658:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725820.680659:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725820.680661:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725820.680673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725820.680720:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426048 00000100:00100000:3.0:1788725820.680724:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426048 00010000:00010000:3.0:1788725820.680744:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725820.680772:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788725820.680781:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791426048:12345-0@lo:103: 00010000:00010000:3.0:1788725820.680793:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725820.680800:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680811:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680831:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949e000/0xa13c582691d36df3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36dec expref: 24 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.680844:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725820.680878:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3640:x1875614791426048:12345-0@lo:103: Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725820.680884:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788725820.680886:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791426048:0@lo:103: 00000100:00100000:0.0:1788725820.680906:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788725820.681153:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425152 00000100:00100000:0.0:1788725820.681163:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425152 00000100:00100000:0.0:1788725820.681501:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425280 00000100:00100000:3.0:1788725820.681502:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425408 00000100:00100000:0.0:1788725820.681507:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425280 00000100:00100000:3.0:1788725820.681509:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425408 00000100:00100000:0.0:1788725820.681527:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425536 00000100:00100000:0.0:1788725820.681532:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425536 00000100:00100000:3.0:1788725820.681538:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425664 00000100:00100000:3.0:1788725820.681544:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425664 00000100:00100000:0.0:1788725820.681552:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425792 00000100:00100000:0.0:1788725820.681557:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425792 00000100:00100000:3.0:1788725820.681564:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791425920 00000100:00100000:3.0:1788725820.681569:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791425920 00000100:00100000:0.0:1788725820.681580:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788725820.681590:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:10323:x1875614791425024:12345-0@lo:104: 00010000:00010000:0.0:1788725820.681603:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725820.681752:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788725820.681760:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:10323:x1875614791425152:12345-0@lo:104: 00010000:00010000:3.0:1788725820.681769:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.681865:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725820.681871:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+10:10323:x1875614791425152:12345-0@lo:104: Request processed in 113us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725820.681877:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788725820.681892:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788725820.681902:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:10323:x1875614791425280:12345-0@lo:104: 00010000:00010000:3.0:1788725820.681910:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.681916:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788725820.681925:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+9:10323:x1875614791425024:12345-0@lo:104: Request processed in 336us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.681941:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788725820.681945:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788725820.681957:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+8:10323:x1875614791425280:12345-0@lo:104: Request processed in 58us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.681960:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788725820.681969:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788725820.681974:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+8:10323:x1875614791425408:12345-0@lo:104: 00010000:00010000:0.0:1788725820.681987:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725820.682005:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788725820.682014:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+7:10323:x1875614791425536:12345-0@lo:104: 00010000:00010000:3.0:1788725820.682022:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.682024:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788725820.682034:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+7:10323:x1875614791425408:12345-0@lo:104: Request processed in 63us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.682042:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788725820.682061:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788725820.682062:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788725820.682069:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:10323:x1875614791425536:12345-0@lo:104: Request processed in 55us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.682075:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:10323:x1875614791425664:12345-0@lo:104: 00000100:00100000:3.0:1788725820.682081:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788725820.682087:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725820.682097:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788725820.682106:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:10323:x1875614791425792:12345-0@lo:104: 00010000:00010000:3.0:1788725820.682142:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.682162:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788725820.682169:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:10323:x1875614791425664:12345-0@lo:104: Request processed in 99us (1743us total) trans 0 rc 0/0 00010000:00010000:3.0:1788725820.682181:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788725820.682187:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:10323:x1875614791425792:12345-0@lo:104: Request processed in 84us (1698us total) trans 0 rc 0/0 00010000:00010000:2.0:1788725820.682235:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788725820.682243:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682250:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6aea00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682253:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682262:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682269:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682280:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682323:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682329:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682345:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682352:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6aea00/0xa13c582691d36d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682364:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788725820.682367:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682372:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682375:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682381:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682388:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682393:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682414:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682419:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682450:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682456:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36dc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36dc9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682465:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788725820.682468:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682473:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afc00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682476:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682482:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682487:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682492:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682503:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682508:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682511:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682517:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6afc00/0xa13c582691d36d7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682524:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788725820.682531:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682536:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682538:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682544:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682549:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682553:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682565:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682570:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682574:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682580:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f600/0xa13c582691d36d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d67 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682588:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788725820.682590:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682596:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682598:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682613:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682619:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682623:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682634:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682640:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682644:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682649:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e400/0xa13c582691d36d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d59 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682657:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725820.682660:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682666:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ae00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682668:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682674:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682679:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682688:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682700:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682705:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682709:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682714:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36d44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d4b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682723:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725820.682725:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682729:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725820.682732:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682738:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725820.682744:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725820.682748:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788725820.682757:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682761:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725820.682769:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682775:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d36d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36d0c expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.682783:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725820.682785:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725820.682787:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725820.682803:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426176:0@lo:103: 00000100:00100000:2.0:1788725820.682846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.682883:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426688:0@lo:103: 00000100:00100000:2.0:1788725820.682899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.682915:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725820.682919:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426560:0@lo:103: 00000100:00100000:2.0:1788725820.682933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.682958:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426432:0@lo:103: 00000100:00100000:2.0:1788725820.682975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.682983:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426944:0@lo:103: 00000100:00100000:2.0:1788725820.682995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.683004:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788725820.683007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426304:0@lo:103: 00000100:00100000:2.0:1788725820.683022:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.683029:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426816:0@lo:103: 00000100:00100000:2.0:1788725820.683045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725820.683067:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426176 00000100:00100000:2.0:1788725820.683072:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426176 00010000:00010000:2.0:1788725820.683113:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 23 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683157:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426688 00000100:00100000:2.0:1788725820.683160:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426688 00010000:00010000:2.0:1788725820.683172:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 24 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683182:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426560 00000100:00100000:2.0:1788725820.683184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426560 00010000:00010000:2.0:1788725820.683193:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 25 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683201:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426432 00000100:00100000:2.0:1788725820.683203:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426432 00010000:00010000:2.0:1788725820.683210:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 26 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683217:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426944 00000100:00100000:2.0:1788725820.683219:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426944 00010000:00010000:2.0:1788725820.683227:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 27 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683235:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426304 00000100:00100000:2.0:1788725820.683236:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426304 00010000:00010000:2.0:1788725820.683244:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 28 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791426816 00000100:00100000:2.0:1788725820.683253:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791426816 00010000:00010000:2.0:1788725820.683261:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 29 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683272:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788725820.683298:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+29:3641:x1875614791426176:12345-0@lo:103: 00010000:00010000:2.0:1788725820.683311:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.683317:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 29 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683327:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 29 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683344:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.683374:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+29:3641:x1875614791426176:12345-0@lo:103: Request processed in 90us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.683379:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788725820.683398:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725820.683404:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+28:3641:x1875614791426688:12345-0@lo:103: 00010000:00010000:2.0:1788725820.683411:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.683415:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 28 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683422:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 28 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683430:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.683449:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+28:3641:x1875614791426688:12345-0@lo:103: Request processed in 46us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.683454:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725820.683465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788725820.683470:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+27:3641:x1875614791426560:12345-0@lo:103: 00010000:00010000:2.0:1788725820.683476:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.683485:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 27 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683492:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 27 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683501:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.683522:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+27:3641:x1875614791426560:12345-0@lo:103: Request processed in 52us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.683528:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788725820.683546:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788725820.683552:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3639:x1875614791426432:12345-0@lo:103: 00010000:00010000:2.0:1788725820.683558:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.683563:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 26 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.683571:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 26 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725820.683576:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788725820.683583:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725820.683599:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425024:0@lo:104: 00000100:00100000:2.0:1788725820.683609:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3639:x1875614791426432:12345-0@lo:103: Request processed in 58us (633us total) trans 0 rc 0/0 00010000:00010000:1.0:1788725820.683612:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949e800/0xa13c582691d36dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d9f expref: 26 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.683615:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788725820.683624:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425152:0@lo:104: 00010000:00010000:1.0:1788725820.683634:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36d83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d7c expref: 25 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725820.683645:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425280:0@lo:104: 00010000:00010000:1.0:1788725820.683654:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6aec00/0xa13c582691d36d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d60 expref: 24 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725820.683675:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425408:0@lo:104: 00010000:00010000:1.0:1788725820.683687:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d52 expref: 23 pid: 6505 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725820.683694:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425536:0@lo:104: 00000100:00100000:1.0:1788725820.683702:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425664:0@lo:104: 00000100:00100000:1.0:1788725820.683709:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425792:0@lo:104: 00000100:00100000:2.0:1788725820.684033:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788725820.684042:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3639:x1875614791426944:12345-0@lo:103: 00010000:00010000:2.0:1788725820.684058:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.684062:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 21 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684076:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 21 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684088:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178a00/0xa13c582691d36d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d05 expref: 21 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684098:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.684258:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3639:x1875614791426944:12345-0@lo:103: Request processed in 218us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.684264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788725820.684278:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788725820.684295:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3639:x1875614791426304:12345-0@lo:103: 00010000:00010000:2.0:1788725820.684302:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.684307:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 19 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684319:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 19 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684328:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179600/0xa13c582691d36dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36dc2 expref: 19 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684337:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.684361:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:3639:x1875614791426304:12345-0@lo:103: Request processed in 78us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.684367:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788725820.684380:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725820.684386:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:3639:x1875614791426816:12345-0@lo:103: 00010000:00010000:2.0:1788725820.684399:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.684403:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 17 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684410:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 17 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684418:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179c00/0xa13c582691d36d4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36d44 expref: 17 pid: 6506 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.684426:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.684446:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3639:x1875614791426816:12345-0@lo:103: Request processed in 61us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725820.684451:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725820.684514:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426304:0@lo:103: 00000100:00100000:2.0:1788725820.684522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426816:0@lo:103: 00000100:00100000:2.0:1788725820.684528:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426432:0@lo:103: 00000100:00100000:2.0:1788725820.684534:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791426944:0@lo:103: 00000100:00100000:3.0:1788725820.684542:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725820.684557:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788725820.684567:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426560:0@lo:103: 00010000:00010000:3.0:1788725820.684571:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725820.684574:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:10323:x1875614791425920:12345-0@lo:104: 00010000:00010000:3.0:1788725820.684579:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725820.684579:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426176:0@lo:103: 00000100:00100000:2.0:1788725820.684588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791426688:0@lo:103: 00010000:00010000:0.0:1788725820.684589:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.684659:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791425920:0@lo:104: 00010000:00010000:0.0:1788725820.684697:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788725820.684705:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:10323:x1875614791425920:12345-0@lo:104: Request processed in 139us (4166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.684711:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788725820.684900:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424640:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725820.684916:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725820.684923:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.684980:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179e00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725820.684992:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.685001:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725820.685008:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725820.685014:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788725820.685054:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.685061:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788725820.685112:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791427072:0@lo:103: 00000100:00100000:2.0:1788725820.685183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725820.685383:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427072 00000100:00100000:0.0:1788725820.685390:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427072 00010000:00010000:0.0:1788725820.685418:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725820.685474:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725820.685483:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:3640:x1875614791427072:12345-0@lo:103: 00010000:00010000:0.0:1788725820.685492:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725820.685496:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.685502:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.685520:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148bc00/0xa13c582691d36ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36cdb expref: 16 pid: 6504 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.685532:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725820.685598:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725820.685607:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179e00/0xa13c582691d36cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ce2 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725820.685618:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:3640:x1875614791427072:12345-0@lo:103: Request processed in 134us (434us total) trans 0 rc 0/0 00010000:00010000:3.0:1788725820.685623:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725820.685627:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788725820.685628:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725820.685632:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725820.685678:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791427072:0@lo:103: 00000100:00100000:2.0:1788725820.686931:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10323:1875614791424768:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725820.686989:0:10323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725820.689876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725820.692211:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402048 00000100:00100000:0.0:1788725820.692231:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402048 00010000:00010000:0.0:1788725820.692304:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 10 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725820.692358:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788725820.692370:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2395:x1875614770402048:12345-192.168.203.12@tcp:103: 00010000:00010000:0.0:1788725820.692390:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788725820.692619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725820.693895:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788725820.693915:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788725820.697693:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402176 00000100:00100000:1.0:1788725820.697714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402176 00010000:00010000:1.0:1788725820.697769:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 11 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.697818:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788725820.697883:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+11:2396:x1875614770402176:12345-192.168.203.12@tcp:103: 00010000:00010000:2.0:1788725820.697908:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725820.697916:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 11 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.697932:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 11 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.697954:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c52 expref: 11 pid: 6504 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725820.697991:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725820.698087:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2396:x1875614770402176:12345-192.168.203.12@tcp:103: Request processed in 236us (5468us total) trans 0 rc 0/0 00010000:00010000:0.0:1788725820.699847:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 10 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.699892:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 10 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.699916:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949fc00/0xa13c582691d36e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c4b expref: 10 pid: 6505 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700041:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700053:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700101:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700108:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700137:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700145:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700152:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725820.700157:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700165:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700188:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725820.700202:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725820.700294:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:2395:x1875614770402048:12345-192.168.203.12@tcp:103: Request processed in 7914us (10420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725820.700306:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00010000:00010000:1.0:1788725820.700665:0:10323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725820.700676:0:10323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725820.700683:0:10323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659600/0xa13c582691d36e47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725820.701209:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788725821.118600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725821.118642:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.118723:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402432 00000100:00100000:0.0:1788725821.118732:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402432 00000100:00100000:0.0:1788725821.118807:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788725821.118829:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770402432:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788725821.118924:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770402432:12345-192.168.203.12@tcp:400: Request processed in 107us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.118932:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788725821.119398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725821.119445:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725821.119469:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.119519:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402304 00000100:00100000:0.0:1788725821.119524:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402304 00000100:00100000:0.0:1788725821.119557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:0.0:1788725821.119565:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:2398:x1875614770402304:12345-192.168.203.12@tcp:400: 00000100:00100000:0.0:1788725821.119601:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:2398:x1875614770402304:12345-192.168.203.12@tcp:400: Request processed in 36us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.119607:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00080000:3.0:1788725821.120962:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725821.120987:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402560 00000100:00100000:3.0:1788725821.120994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402560 00000100:00100000:3.0:1788725821.121110:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788725821.121158:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402560:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788725821.121214:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402560:12345-192.168.203.12@tcp:400: Request processed in 96us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725821.121233:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00080000:0.0:1788725821.125086:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725821.129277:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402688 00000100:00100000:1.0:1788725821.129301:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402688 00000100:00100000:1.0:1788725821.129432:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402816 00000100:00100000:1.0:1788725821.129436:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402816 00000100:00100000:3.0:1788725821.130667:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788725821.130685:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402688:12345-192.168.203.12@tcp:400: 00000100:00100000:3.0:1788725821.131576:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402688:12345-192.168.203.12@tcp:400: Request processed in 893us (12929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725821.131588:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00080000:0.0:1788725821.135508:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725821.135519:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725821.135950:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788725821.135965:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402816:12345-192.168.203.12@tcp:400: 00000100:00100000:1.0:1788725821.136055:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770402816:12345-192.168.203.12@tcp:400: Request processed in 95us (16584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725821.136063:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00010000:00010000:3.0:1788725821.308443:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725821.896694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.896810:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770402944 00000100:00100000:0.0:1788725821.896821:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770402944 00000100:00100000:0.0:1788725821.896878:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:0.0:1788725821.896889:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+8:6168:x1875614770402944:12345-192.168.203.12@tcp:101: 00010000:00010000:0.0:1788725821.896922:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725821.897101:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6cc2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725821.897357:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc2 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725821.897372:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc2 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725821.897381:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae800, rc 0) 00000100:00100000:0.0:1788725821.897447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770402944:12345-192.168.203.12@tcp:101: Request processed in 560us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.897454:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:2.0:1788725821.910692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.910889:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403072 00000100:00100000:0.0:1788725821.910898:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403072 00000100:00100000:0.0:1788725821.910955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:0.0:1788725821.911225:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403072:12345-192.168.203.12@tcp:501: 00000100:00100000:0.0:1788725821.911398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403072:12345-192.168.203.12@tcp:501: Request processed in 178us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.911407:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788725821.920038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.921887:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403200 00000100:00100000:0.0:1788725821.921903:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403200 00000100:00100000:0.0:1788725821.922573:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:0.0:1788725821.922584:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403200:12345-192.168.203.12@tcp:503: 00000100:00100000:0.0:1788725821.922745:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403200:12345-192.168.203.12@tcp:503: Request processed in 162us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.922754:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1788725821.932612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.932716:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403328 00000100:00100000:0.0:1788725821.932726:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403328 00000100:00100000:0.0:1788725821.932783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1788725821.932794:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6650:x1875614770403328:12345-192.168.203.12@tcp:502: 00000100:00100000:0.0:1788725821.932982:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6650:x1875614770403328:12345-192.168.203.12@tcp:502: Request processed in 190us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725821.932990:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:2.0:1788725821.934960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725821.935140:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403456 00000100:00100000:3.0:1788725821.935149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403456 00000100:00100000:3.0:1788725821.935197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:3.0:1788725821.935206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6650:x1875614770403456:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788725821.935351:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6650:x1875614770403456:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 146us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725821.935359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1788725821.940665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725821.940930:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403584 00000100:00100000:3.0:1788725821.940940:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403584 00000100:00100000:3.0:1788725821.941113:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:3.0:1788725821.941165:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403584:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725821.941181:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725821.941199:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178600/0xa13c582691d36e55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6cc9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725821.941226:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178600/0xa13c582691d36e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc9 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725821.941266:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178600/0xa13c582691d36e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc9 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725821.941283:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178600, rc 0) 00000100:00100000:3.0:1788725821.941349:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770403584:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 187us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725821.941357:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:2.0:1788725821.950048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725821.950473:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403712 00000100:00100000:0.0:1788725821.950484:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403712 00000100:00100000:0.0:1788725821.950556:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:0.0:1788725821.950565:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770403712:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725821.950903:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770403712:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 337us (862us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725821.950912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00010000:00010000:3.0:1788725822.332857:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788725822.523306:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788725822.523314:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b1282214000 from 48 10000000:01000000:2.0:1788725822.523320:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788725822.523374:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.523387:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.523399:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725822.523424:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427200:0@lo:101: 00000100:00100000:2.0:1788725822.523497:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.523576:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.523651:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427200 00000100:00100000:3.0:1788725822.523659:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427200 00000100:00100000:3.0:1788725822.523708:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788725822.523717:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+15:6509:x1875614791427200:12345-0@lo:101: 00010000:00010000:3.0:1788725822.523730:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725822.523743:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179e00/0xa13c582691d36e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36e5c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.523768:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179e00/0xa13c582691d36e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36e5c expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.523779:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179e00/0xa13c582691d36e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36e5c expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.523789:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179e00, rc 0) 00000100:00100000:3.0:1788725822.523848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427200:12345-0@lo:101: Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.523854:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788725822.524105:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427200:0@lo:101: 00010000:00010000:2.0:1788725822.524141:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.524151:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725822.524228:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427328:0@lo:501: 00000100:00100000:2.0:1788725822.524256:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.524312:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.524491:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427328 00000100:00100000:0.0:1788725822.524496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427328 00000100:00100000:0.0:1788725822.524532:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788725822.524539:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427328:12345-0@lo:501: 00000100:00100000:0.0:1788725822.524659:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427328:12345-0@lo:501: Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.524665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788725822.524740:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427328:0@lo:501: 00000100:00100000:1.0:1788725822.524770:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427456:0@lo:503: 00000100:00100000:1.0:1788725822.524823:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.524845:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.525079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427456 00000100:00100000:0.0:1788725822.525084:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427456 00000100:00100000:0.0:1788725822.525105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788725822.525112:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427456:12345-0@lo:503: 00000100:00100000:0.0:1788725822.525224:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427456:12345-0@lo:503: Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.525231:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788725822.525425:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427456:0@lo:503: 00000100:00100000:1.0:1788725822.525869:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10342:1875614791427584:0@lo:502: 00000100:00100000:1.0:1788725822.525910:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.526152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427584 00000100:00100000:0.0:1788725822.526158:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427584 00000100:00100000:0.0:1788725822.526198:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788725822.526207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:10342:x1875614791427584:12345-0@lo:502: 00000100:00100000:0.0:1788725822.530205:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:10342:x1875614791427584:12345-0@lo:502: Request processed in 3991us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.530220:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788725822.530427:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725822.530455:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10342:1875614791427584:0@lo:502: 00000100:00100000:1.0:1788725822.530525:0:10342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10342:1875614791427712:0@lo:502: 00000100:00100000:1.0:1788725822.530571:0:10342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.530600:0:10342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.530906:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427712 00000100:00100000:2.0:1788725822.530913:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427712 00000100:00100000:2.0:1788725822.531177:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788725822.531188:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:10342:x1875614791427712:12345-0@lo:502: 00000100:00100000:2.0:1788725822.531333:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:10342:x1875614791427712:12345-0@lo:502: Request processed in 147us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.531340:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788725822.531415:0:10342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10342:1875614791427712:0@lo:502: 00000040:00080000:1.0:1788725822.531436:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788725822.534279:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788725822.534317:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788725822.534329:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.534342:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725822.534353:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788725822.534356:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788725822.534360:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788725822.534399:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.534408:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.534420:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725822.534443:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427840:0@lo:101: 00000100:00100000:0.0:1788725822.534501:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.534545:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd62e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.534609:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427840 00000100:00100000:3.0:1788725822.534630:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427840 00000100:00100000:3.0:1788725822.534681:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788725822.534690:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+16:6509:x1875614791427840:12345-0@lo:101: 00010000:00010000:3.0:1788725822.534702:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725822.534714:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36e71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36e6a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.534737:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36e6a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.534747:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36e6a expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.534756:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178e00, rc 0) 00000100:00100000:3.0:1788725822.534794:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791427840:12345-0@lo:101: Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.534800:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788725822.535515:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427840:0@lo:101: 00010000:00010000:0.0:1788725822.535534:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.535543:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725822.535621:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427968:0@lo:501: 00000100:00100000:0.0:1788725822.535653:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.535685:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd62e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.535753:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791427968 00000100:00100000:3.0:1788725822.535758:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791427968 00000100:00100000:3.0:1788725822.535794:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788725822.535802:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791427968:12345-0@lo:501: 00000100:00100000:3.0:1788725822.535944:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791427968:12345-0@lo:501: Request processed in 142us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.535951:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788725822.536332:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791427968:0@lo:501: 00000100:00100000:1.0:1788725822.536363:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428096:0@lo:503: 00000100:00100000:1.0:1788725822.536408:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.536443:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.536533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428096 00000100:00100000:3.0:1788725822.536538:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428096 00000100:00100000:3.0:1788725822.536570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788725822.536578:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791428096:12345-0@lo:503: 00000100:00100000:3.0:1788725822.536667:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791428096:12345-0@lo:503: Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.536679:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788725822.536773:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428096:0@lo:503: 00000100:00100000:1.0:1788725822.539468:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10343:1875614791428224:0@lo:502: 00000100:00100000:1.0:1788725822.539550:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.539646:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.543218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428224 00000100:00100000:3.0:1788725822.543233:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428224 00000100:00100000:3.0:1788725822.543313:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788725822.543325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:10343:x1875614791428224:12345-0@lo:502: 00000100:00100000:3.0:1788725822.543516:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:10343:x1875614791428224:12345-0@lo:502: Request processed in 192us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.543524:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788725822.543690:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10343:1875614791428224:0@lo:502: 00000020:01000000:2.0:1788725822.543727:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725822.543737:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725822.543739:0:10343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788725822.543746:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788725822.543782:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10343:1875614791428352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.543828:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.543863:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.543918:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428352 00000100:00100000:3.0:1788725822.543923:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428352 00000100:00100000:3.0:1788725822.544164:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788725822.544173:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:10343:x1875614791428352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.544254:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:10343:x1875614791428352:12345-0@lo:502:llog_process_th.0 Request processed in 81us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.544261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788725822.544339:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10343:1875614791428352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788725822.544360:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725822.544365:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725822.544367:0:10343:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788725822.544371:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788725822.545237:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788725822.545263:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788725822.545285:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.545297:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725822.545308:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788725822.545311:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139e52d000 from 48 10000000:01000000:1.0:1788725822.545314:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788725822.545344:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.545352:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.545361:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.545380:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.545421:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.558241:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.569587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428480 00000100:00100000:0.0:1788725822.569603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428480 00000100:00100000:0.0:1788725822.569667:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788725822.569678:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+17:6509:x1875614791428480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725822.569696:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725822.569714:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36e7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36e78 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.569744:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36e7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36e78 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.569756:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36e7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36e78 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.569766:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6ae000, rc 0) 00000100:00100000:0.0:1788725822.569851:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791428480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (24428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.569858:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788725822.569929:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725822.569962:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.569972:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.570048:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.570083:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.570138:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.570147:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428608 00000100:00100000:0.0:1788725822.570151:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428608 00000100:00100000:0.0:1788725822.570180:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788725822.570187:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791428608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.570311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791428608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.570324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788725822.570351:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.570392:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.570434:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.570458:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.570503:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428736 00000100:00100000:2.0:1788725822.570508:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428736 00000100:00100000:2.0:1788725822.570539:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788725822.570546:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791428736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.570633:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791428736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.570640:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788725822.570853:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791428736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.571410:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10344:1875614791428864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.571450:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.571480:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.571495:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428864 00000100:00100000:3.0:1788725822.571501:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428864 00000100:00100000:3.0:1788725822.571534:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788725822.571543:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:10344:x1875614791428864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.571647:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:10344:x1875614791428864:12345-0@lo:502:llog_process_th.0 Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.571655:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788725822.571661:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10344:1875614791428864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.571696:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10344:1875614791428992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.571727:0:10344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.571748:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.571793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791428992 00000100:00100000:0.0:1788725822.571797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791428992 00000100:00100000:0.0:1788725822.571826:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788725822.571833:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:10344:x1875614791428992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.571911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:10344:x1875614791428992:12345-0@lo:502:llog_process_th.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.571917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788725822.571992:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10344:1875614791428992:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788725822.572012:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788725822.572134:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788725822.572157:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788725822.572165:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.572175:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725822.572185:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788725822.572187:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788725822.572190:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788725822.572211:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.572229:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.572238:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.572251:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.572289:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.572352:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.575020:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429120 00000100:00100000:3.0:1788725822.575053:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429120 00000100:00100000:3.0:1788725822.575104:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788725822.575473:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+18:6509:x1875614791429120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725822.575491:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725822.575512:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2178800/0xa13c582691d36e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36e86 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.575539:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2178800/0xa13c582691d36e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36e86 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.575551:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2178800/0xa13c582691d36e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36e86 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.575561:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178800, rc 0) 00000100:00100000:3.0:1788725822.575692:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791429120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 579us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.575700:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788725822.578008:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725822.578037:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.578050:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.578500:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.578559:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.578604:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.584508:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429248 00000100:00100000:2.0:1788725822.584523:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429248 00000100:00100000:2.0:1788725822.584586:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788725822.584596:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791429248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.584769:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791429248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (6209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.584776:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788725822.584862:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.584914:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.584970:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.585006:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.585044:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429376 00000100:00100000:0.0:1788725822.585049:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429376 00000100:00100000:0.0:1788725822.585082:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788725822.585090:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791429376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.585210:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791429376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.585218:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788725822.585246:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791429376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.586145:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10345:1875614791429504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.586197:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.586226:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.586487:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429504 00000100:00100000:3.0:1788725822.586495:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429504 00000100:00100000:3.0:1788725822.586541:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788725822.586551:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:10345:x1875614791429504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.586670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:10345:x1875614791429504:12345-0@lo:502:llog_process_th.0 Request processed in 120us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.586679:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788725822.587251:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725822.587266:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791429632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725822.587326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.587363:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429632 00000100:00100000:1.0:1788725822.587368:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429632 00000100:00100000:1.0:1788725822.587422:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788725822.587430:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791429632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725822.587453:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725822.587490:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791429632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.587496:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788725822.587529:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f0e00 x1875614791429632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725822.587545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791429632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725822.587738:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791429760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725822.587769:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.587782:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10345:1875614791429504:0@lo:502:llog_process_th.0 00000100:00080000:0.0:1788725822.587798:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:2.0:1788725822.587812:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725822.587822:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725822.587824:0:10345:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788725822.587830:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788725822.587852:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10345:1875614791429888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.587887:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.587909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429888 00000100:00100000:2.0:1788725822.587917:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429888 00000100:00100000:2.0:1788725822.587942:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788725822.587948:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:10345:x1875614791429888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725822.587949:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791430400:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.587976:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.587992:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791430912:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.588026:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:10345:x1875614791429888:12345-0@lo:502:llog_process_th.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588029:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788725822.588034:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791430016:0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.588044:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788725822.588056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588074:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791430528:0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.588083:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725822.588094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.588095:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10345:1875614791429888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725822.588109:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791431040:0@lo:400:kworker.0 00000020:01000000:2.0:1788725822.588110:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725822.588114:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725822.588131:0:10345:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788725822.588135:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000100:00100000:1.0:1788725822.588144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588166:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430016 00000100:00100000:1.0:1788725822.588170:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430016 00000100:00100000:1.0:1788725822.588199:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430528 00000100:00100000:1.0:1788725822.588202:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430528 00000100:00100000:1.0:1788725822.588219:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431040 00000100:00100000:1.0:1788725822.588221:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431040 00000100:00100000:1.0:1788725822.588235:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788725822.588241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791430016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588295:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791430016:12345-0@lo:400:kworker.0 Request processed in 54us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588301:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788725822.588313:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788725822.588319:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791430528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.588342:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791430016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588347:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791430528:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.588351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791430528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588352:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788725822.588363:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788725822.588369:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791431040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791431040:12345-0@lo:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588430:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788725822.588441:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791431040:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588454:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430912 00000100:00100000:1.0:1788725822.588457:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430912 00000100:00100000:1.0:1788725822.588488:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788725822.588495:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791430912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588532:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791430912:12345-0@lo:400:kworker.0 Request processed in 38us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588538:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788725822.588542:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af862300 x1875614791430912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725822.588551:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791430912:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588553:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791429760 00000100:00100000:1.0:1788725822.588561:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791429760 00000100:00100000:1.0:1788725822.588592:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725822.588598:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791429760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725822.588610:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725822.588639:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791429760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588644:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725822.588662:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791430144:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588701:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791430656:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588733:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791431168:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588767:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788725822.588773:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791430272:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588792:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791430784:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.588847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430656 00000100:00100000:1.0:1788725822.588851:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430656 00000100:00100000:1.0:1788725822.588869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431168 00000100:00100000:1.0:1788725822.588872:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431168 00000100:00100000:1.0:1788725822.588881:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430272 00000100:00100000:1.0:1788725822.588884:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430272 00000100:00100000:1.0:1788725822.588895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788725822.588901:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588936:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791430656:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.588950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788725822.588963:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788725822.588969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791431168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.588998:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791431168:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.589004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788725822.589017:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788725822.589023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791430272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.589048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791430272:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725822.589053:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788725822.589075:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430400 00000100:00100000:2.0:1788725822.589079:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430400 00000100:00100000:1.0:1788725822.589084:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791430272:0@lo:400:kworker.0 00010000:00080000:1.0:1788725822.589094:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af862680 x1875614791430656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725822.589102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791430656:0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.589103:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430144 00000100:00100000:2.0:1788725822.589105:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430144 00000100:00100000:2.0:1788725822.589143:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788725822.589151:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791430400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.589185:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791430400:12345-0@lo:400:kworker.0 Request processed in 36us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.589197:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788725822.589211:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788725822.589217:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791430144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.589244:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791430144:12345-0@lo:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.589250:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788725822.589265:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791430784 00000100:00100000:2.0:1788725822.589268:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791430784 00000100:00100000:2.0:1788725822.589305:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725822.589312:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791430784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725822.589340:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791430784:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.589346:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788725822.589383:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791430400:0@lo:400:kworker.0 00010000:00080000:2.0:1788725822.589395:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387637100 x1875614791429760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725822.589409:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791429760:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788725822.590181:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725822.590188:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725822.590191:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725822.590193:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788725822.590525:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788725822.590558:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788725822.590569:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.590592:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725822.590602:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788725822.590605:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b13bd660800 from 48 10000000:01000000:3.0:1788725822.590608:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725822.590640:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.590647:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.590657:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.590677:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.590721:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.590752:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.590771:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431296 00000100:00100000:3.0:1788725822.590776:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431296 00000100:00100000:3.0:1788725822.590826:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788725822.591018:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:6509:x1875614791431296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725822.591030:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725822.591043:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179600/0xa13c582691d36e9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36e94 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.591064:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179600/0xa13c582691d36e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36e94 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.591088:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179600/0xa13c582691d36e9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36e94 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.591097:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179600, rc 0) 00000100:00100000:3.0:1788725822.591151:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.591158:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788725822.591181:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725822.591195:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.591215:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725822.591282:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.591309:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725822.591325:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13ab2f4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.591378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431424 00000100:00100000:0.0:1788725822.591382:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431424 00000100:00100000:0.0:1788725822.591414:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788725822.591421:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.591535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.591542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788725822.591557:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.591583:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.591953:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.591980:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.592340:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431552 00000100:00100000:0.0:1788725822.592345:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431552 00000100:00100000:0.0:1788725822.592381:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788725822.592389:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.592472:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.592479:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00080000:1.0:1788725822.596080:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af861880 x1875614791431168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725822.596098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791431168:0@lo:400:kworker.0 00010000:00080000:1.0:1788725822.596156:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af863b80 x1875614791430784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725822.596166:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791430784:0@lo:400:kworker.0 00000100:00100000:1.0:1788725822.596177:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791430144:0@lo:400:kworker.0 00000100:00100000:3.0:1788725822.597784:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.599268:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10346:1875614791431680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.599373:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.599424:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.599478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431680 00000100:00100000:2.0:1788725822.599486:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431680 00000100:00100000:2.0:1788725822.599541:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788725822.599552:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:10346:x1875614791431680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.599694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:10346:x1875614791431680:12345-0@lo:502:llog_process_th.0 Request processed in 143us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.599702:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788725822.599720:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10346:1875614791431680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.599759:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10346:1875614791431808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.599791:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.599813:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.599858:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431808 00000100:00100000:3.0:1788725822.599863:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431808 00000100:00100000:3.0:1788725822.599894:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788725822.599901:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:10346:x1875614791431808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.599976:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:10346:x1875614791431808:12345-0@lo:502:llog_process_th.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.599982:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788725822.600068:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10346:1875614791431808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788725822.600087:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788725822.600207:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788725822.600228:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788725822.600238:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.600249:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725822.600267:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788725822.600279:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788725822.600282:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788725822.600309:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.600317:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.600326:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.600341:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.600370:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.600401:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.600469:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791431936 00000100:00100000:2.0:1788725822.600473:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791431936 00000100:00100000:2.0:1788725822.600505:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788725822.600513:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791431936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725822.600522:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725822.600534:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383658200/0xa13c582691d36ea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ea2 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.600556:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383658200/0xa13c582691d36ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ea2 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.600579:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383658200/0xa13c582691d36ea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ea2 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725822.600588:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658200, rc 0) 00000100:00100000:2.0:1788725822.600623:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791431936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.600630:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788725822.600642:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791431936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725822.600655:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.600664:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.600713:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.600736:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.600757:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.600805:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432064 00000100:00100000:0.0:1788725822.600809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432064 00000100:00100000:0.0:1788725822.600840:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788725822.600848:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791432064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.600967:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791432064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.600973:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788725822.601019:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.601053:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.601094:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.601144:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.601223:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432192 00000100:00100000:2.0:1788725822.601227:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432192 00000100:00100000:2.0:1788725822.601247:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788725822.601252:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791432192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.601346:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791432192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.601353:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788725822.601390:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.602279:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10347:1875614791432320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.602328:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.602363:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.602413:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432320 00000100:00100000:3.0:1788725822.602425:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432320 00000100:00100000:3.0:1788725822.602462:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788725822.602471:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10347:x1875614791432320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.602585:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10347:x1875614791432320:12345-0@lo:502:llog_process_th.0 Request processed in 115us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.602593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788725822.602723:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10347:1875614791432320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725822.602756:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725822.602765:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725822.602768:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788725822.602775:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788725822.602795:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10347:1875614791432448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.602827:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.602849:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389e7f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.602893:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432448 00000100:00100000:3.0:1788725822.602897:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432448 00000100:00100000:3.0:1788725822.602928:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788725822.602935:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10347:x1875614791432448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.603007:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10347:x1875614791432448:12345-0@lo:502:llog_process_th.0 Request processed in 72us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.603014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788725822.603203:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10347:1875614791432448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725822.603221:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725822.603226:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725822.603228:0:10347:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788725822.603232:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788725822.603375:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788725822.603397:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788725822.603407:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.603417:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725822.603426:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788725822.603428:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139116a000 from 48 10000000:01000000:3.0:1788725822.603430:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788725822.603453:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.603462:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.603477:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.603492:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.603519:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.603552:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.603593:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432576 00000100:00100000:0.0:1788725822.603597:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432576 00000100:00100000:0.0:1788725822.603631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788725822.603638:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791432576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725822.603648:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725822.603660:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6aee00/0xa13c582691d36eb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36eb0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.603680:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6aee00/0xa13c582691d36eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36eb0 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.603691:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6aee00/0xa13c582691d36eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36eb0 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.603700:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6aee00, rc 0) 00000100:00100000:0.0:1788725822.603737:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791432576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.603748:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788725822.603804:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725822.603817:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.603826:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.603874:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.603898:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.603919:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.603956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432704 00000100:00100000:0.0:1788725822.603960:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432704 00000100:00100000:0.0:1788725822.603989:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788725822.603996:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791432704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725822.604111:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791432704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.604148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788725822.604194:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.604224:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.604262:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.604300:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.604339:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432832 00000100:00100000:2.0:1788725822.604344:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432832 00000100:00100000:2.0:1788725822.604378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788725822.604393:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791432832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.604476:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791432832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.604483:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788725822.604605:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791432832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.604870:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10348:1875614791432960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.604906:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.604928:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.604999:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791432960 00000100:00100000:2.0:1788725822.605004:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791432960 00000100:00100000:2.0:1788725822.605032:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788725822.605039:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10348:x1875614791432960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725822.605151:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10348:x1875614791432960:12345-0@lo:502:llog_process_th.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725822.605163:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788725822.605579:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10348:1875614791432960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.605620:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10348:1875614791433088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.605653:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725822.605685:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389e7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.606142:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433088 00000100:00100000:3.0:1788725822.606148:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433088 00000100:00100000:3.0:1788725822.606187:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788725822.606196:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10348:x1875614791433088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.606306:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10348:x1875614791433088:12345-0@lo:502:llog_process_th.0 Request processed in 110us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.606322:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788725822.606391:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10348:1875614791433088:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788725822.606415:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788725822.606859:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788725822.606885:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788725822.606897:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.606909:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725822.606919:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788725822.606921:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788725822.606924:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788725822.606957:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.606966:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.606987:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.607004:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.607039:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.607074:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.607150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433216 00000100:00100000:3.0:1788725822.607155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433216 00000100:00100000:3.0:1788725822.607186:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788725822.607196:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791433216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725822.607205:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725822.607217:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1380030a00/0xa13c582691d36ec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ebe expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.607238:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1380030a00/0xa13c582691d36ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ebe expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.607248:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1380030a00/0xa13c582691d36ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ebe expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.607255:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380030a00, rc 0) 00000100:00100000:3.0:1788725822.607303:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.607310:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788725822.607346:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725822.607358:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.607367:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.607430:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.607454:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.607477:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.609161:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433344 00000100:00100000:3.0:1788725822.609172:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433344 00000100:00100000:3.0:1788725822.609226:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788725822.609235:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.609402:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.609410:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788725822.609490:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.609539:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.609589:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.609620:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.609822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433472 00000100:00100000:3.0:1788725822.609833:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433472 00000100:00100000:3.0:1788725822.609865:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788725822.609872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.609956:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.609962:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788725822.609992:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.610362:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10349:1875614791433600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.610394:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.610451:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.612700:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433600 00000100:00100000:0.0:1788725822.612715:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433600 00000100:00100000:0.0:1788725822.612784:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788725822.612794:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10349:x1875614791433600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725822.613023:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10349:x1875614791433600:12345-0@lo:502:llog_process_th.0 Request processed in 230us (2627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.613031:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788725822.617192:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10349:1875614791433600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725822.617475:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725822.617490:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725822.617493:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788725822.617499:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788725822.617554:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10349:1875614791433728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725822.617625:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.617659:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725822.617723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433728 00000100:00100000:3.0:1788725822.617730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433728 00000100:00100000:3.0:1788725822.617786:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788725822.617795:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10349:x1875614791433728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725822.617928:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10349:x1875614791433728:12345-0@lo:502:llog_process_th.0 Request processed in 133us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725822.617936:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788725822.618556:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10349:1875614791433728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725822.618582:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725822.618588:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725822.618591:0:10349:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788725822.618594:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788725822.618754:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788725822.618777:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788725822.618786:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.618796:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725822.618806:0:6509:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788725822.618809:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b13a96d0000 from 1 10000000:01000000:3.0:1788725822.618820:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788725822.618847:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.618855:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725822.618865:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725822.618881:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725822.618916:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725822.618947:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725822.619004:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433856 00000100:00100000:0.0:1788725822.619008:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433856 00000100:00100000:0.0:1788725822.619058:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788725822.619067:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791433856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725822.619083:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725822.619096:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af800/0xa13c582691d36ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ecc expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.619149:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af800/0xa13c582691d36ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ecc expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.619160:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af800/0xa13c582691d36ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ecc expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725822.619169:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af800, rc 0) 00000100:00100000:0.0:1788725822.619203:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791433856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725822.619209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788725822.619349:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725822.619361:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.619371:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725822.619423:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725822.619448:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725822.619473:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725822.619505:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791433984 00000100:00100000:2.0:1788725822.619510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791433984 00000100:00100000:2.0:1788725822.619542:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788725822.619550:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791433984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725822.619628:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791433984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788725822.619635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788725822.619697:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791433984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788725822.619717:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788725822.619722:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725822.619729:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.355322:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725823.613874:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725823.613896:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791434112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725823.613964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725823.614077:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434112 00000100:00100000:0.0:1788725823.614085:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434112 00000100:00100000:0.0:1788725823.614159:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788725823.614169:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791434112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725823.614199:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725823.614243:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791434112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725823.614250:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788725823.614397:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791434112:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788725823.903930:0:10386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe61fc5170 20000000:00000080:1.0:1788725823.903951:0:10386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b13be83fc00 uarg=0000000000000000 20000000:01000000:1.0:1788725823.903997:0:10386:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788725823.904002:0:10386:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788725823.904006:0:10386:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788725823.904592:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788725823.904722:0:10386:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788725823.909771:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788725823.909814:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788725823.909830:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788725823.909848:0:10386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788725823.909868:0:10386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909885:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b6f expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909892:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36b7d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909899:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909906:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909932:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909940:0:10386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.909983:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.910015:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 9 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.910035:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434240:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725823.910675:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.910686:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 23 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.910697:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434368:0@lo:104: 00000100:00100000:1.0:1788725823.910733:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725823.910768:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.910777:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 23 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.910785:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434496:0@lo:104: 00000100:00100000:1.0:1788725823.910817:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788725823.910837:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.910845:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 23 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.910852:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434624:0@lo:104: 00010000:00010000:1.0:1788725823.910875:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725823.910890:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 23 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.910899:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434752:0@lo:104: 00000100:00100000:1.0:1788725823.910917:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725823.911082:0:10329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788725823.911101:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.911174:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.911183:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434368 00000100:00100000:3.0:1788725823.911189:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434368 00000100:00100000:3.0:1788725823.911226:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434496 00000100:00100000:3.0:1788725823.911229:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434496 00000100:00100000:3.0:1788725823.911237:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434624 00000100:00100000:3.0:1788725823.911240:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434624 00000100:00100000:3.0:1788725823.911248:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434752 00000100:00100000:3.0:1788725823.911250:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434752 00000100:00100000:3.0:1788725823.911272:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788725823.911281:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:10386:x1875614791434368:12345-0@lo:104: 00010000:00010000:3.0:1788725823.911294:0:10329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911340:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788725823.911352:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+6:10386:x1875614791434368:12345-0@lo:104: Request processed in 72us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.911359:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788725823.911376:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725823.911381:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af826050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:10386:x1875614791434496:12345-0@lo:104: 00010000:00010000:3.0:1788725823.911389:0:10329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911419:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788725823.911424:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af826050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+5:10386:x1875614791434496:12345-0@lo:104: Request processed in 43us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.911430:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725823.911459:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725823.911464:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:10386:x1875614791434624:12345-0@lo:104: 00010000:00010000:3.0:1788725823.911471:0:10329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911496:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788725823.911501:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:10386:x1875614791434624:12345-0@lo:104: Request processed in 37us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.911506:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725823.911516:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725823.911521:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:10386:x1875614791434752:12345-0@lo:104: 00010000:00010000:3.0:1788725823.911528:0:10329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911551:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788725823.911561:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:10386:x1875614791434752:12345-0@lo:104: Request processed in 40us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.911567:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788725823.911588:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788725823.911594:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911603:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725823.911607:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911616:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725823.911624:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725823.911631:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788725823.911663:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911670:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725823.911689:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911696:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e600/0xa13c582691d36cf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36cfe expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911708:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788725823.911711:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911727:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725823.911730:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911737:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725823.911744:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725823.911748:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788725823.911762:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911768:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725823.911773:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911779:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f200/0xa13c582691d36bd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36bd8 expref: -99 pid: 8419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911787:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725823.911790:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911796:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725823.911798:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911813:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725823.911820:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725823.911826:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788725823.911836:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911842:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725823.911855:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911862:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148a200/0xa13c582691d36b7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b84 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911871:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725823.911875:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911880:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afe00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725823.911883:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911889:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725823.911896:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725823.911906:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788725823.911918:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911937:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725823.911943:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911950:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36b6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36b76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.911962:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725823.911964:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725823.911966:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725823.911973:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725823.911978:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725823.911988:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791434880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.912048:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725823.912054:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791435008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.912098:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791435136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.912157:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725823.912162:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791435264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725823.912203:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791434880 00000100:00100000:3.0:1788725823.912213:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791434880 00010000:00010000:3.0:1788725823.912232:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 24 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725823.912245:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435008 00000100:00100000:3.0:1788725823.912248:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435008 00010000:00010000:3.0:1788725823.912285:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 25 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725823.912298:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435136 00000100:00100000:3.0:1788725823.912300:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435136 00010000:00010000:3.0:1788725823.912309:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 26 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725823.912318:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435264 00000100:00100000:3.0:1788725823.912320:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435264 00010000:00010000:3.0:1788725823.912328:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 27 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725823.912339:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725823.912345:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+27:3638:x1875614791434880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788725823.912356:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725823.912361:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 27 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912370:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 27 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912385:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725823.912414:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+27:3638:x1875614791434880:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.912420:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788725823.912441:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725823.912447:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3638:x1875614791435008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788725823.912454:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725823.912459:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 26 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912468:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 26 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912478:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725823.912497:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3638:x1875614791435008:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.912503:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788725823.912514:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788725823.912519:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+25:3640:x1875614791435136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788725823.912526:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725823.912530:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 25 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912539:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 25 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912547:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725823.912569:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+25:3640:x1875614791435136:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.912575:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788725823.912585:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788725823.912591:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791435264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788725823.912607:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725823.912612:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 24 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912621:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 24 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.912631:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725823.912649:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791435264:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725823.912656:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788725823.912708:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791435264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912716:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791435136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912735:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791435008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725823.912742:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791434880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725823.913299:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148ac00/0xa13c582691d36cfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36cf7 expref: 23 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.913314:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434368:0@lo:104: 00010000:00010000:1.0:1788725823.913324:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f400/0xa13c582691d36bd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36bd1 expref: 22 pid: 6506 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.913333:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434496:0@lo:104: 00010000:00010000:1.0:1788725823.913342:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af400/0xa13c582691d36b84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b7d expref: 21 pid: 6505 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.913350:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434624:0@lo:104: 00010000:00010000:1.0:1788725823.913360:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949fe00/0xa13c582691d36b76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36b6f expref: 20 pid: 6504 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725823.913367:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434752:0@lo:104: 00000100:00100000:2.0:1788725823.915764:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725823.915837:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403840 00000100:00100000:0.0:1788725823.915846:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403840 00010000:00010000:0.0:1788725823.915882:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 10 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725823.915937:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788725823.915959:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2396:x1875614770403840:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725823.915974:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725823.915980:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 10 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.915993:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 10 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916013:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916021:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916037:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916044:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916051:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916057:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916063:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725823.916067:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916075:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916091:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725823.916102:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725823.916184:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2396:x1875614770403840:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 226us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725823.916192:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00010000:00010000:3.0:1788725823.918455:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383658400/0xa13c582691d36e16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c8a expref: 9 pid: 6506 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725823.918475:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1875614791434240:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725823.918510:0:10386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.918520:0:10386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.918526:0:10386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725823.918549:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36eda lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725824.235230:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788725824.235238:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1282214000 from 4 10000000:01000000:1.0:1788725824.235243:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788725824.235307:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.235318:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.235344:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725824.235370:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.235438:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725824.235589:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435392 00000100:00100000:3.0:1788725824.235596:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435392 00000100:00100000:3.0:1788725824.235646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788725824.235657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791435392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725824.235670:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725824.235683:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36ee1 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725824.235705:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725824.235716:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725824.235724:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380030400, rc 0) 00000100:00100000:3.0:1788725824.235758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791435392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725824.235764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788725824.235953:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.235989:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725824.236003:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.236012:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725824.236072:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.236098:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.236109:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725824.236455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435520 00000100:00100000:2.0:1788725824.236460:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435520 00000100:00100000:2.0:1788725824.236596:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788725824.236604:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791435520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.236721:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791435520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725824.236728:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788725824.236794:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.236824:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.236879:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.250907:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725824.251256:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435648 00000100:00100000:3.0:1788725824.251274:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435648 00000100:00100000:1.0:1788725824.251401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788725824.251411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791435648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.251575:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791435648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (14694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.251593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788725824.251749:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791435648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725824.253080:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10399:1875614791435776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725824.253172:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725824.253207:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.253271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435776 00000100:00100000:1.0:1788725824.253277:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435776 00000100:00100000:1.0:1788725824.253317:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788725824.253327:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10399:x1875614791435776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.253473:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10399:x1875614791435776:12345-0@lo:502:llog_process_th.0 Request processed in 147us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.253481:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788725824.256731:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10399:1875614791435776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725824.256778:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725824.256789:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725824.256791:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788725824.256797:0:10399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1282214000 00000020:00000080:3.0:1788725824.256799:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788725824.263403:0:10399:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10399:1875614791435904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725824.263497:0:10399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725824.263546:0:10399:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.265569:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791435904 00000100:00100000:1.0:1788725824.265582:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791435904 00000100:00100000:1.0:1788725824.265652:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788725824.265662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10399:x1875614791435904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.265844:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:10399:x1875614791435904:12345-0@lo:502:llog_process_th.0 Request processed in 183us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.265852:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788725824.267341:0:10399:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10399:1875614791435904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725824.267388:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725824.267398:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725824.267401:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788725824.267411:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788725824.267584:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788725824.267606:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725824.267616:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.267626:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725824.267636:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788725824.267638:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e52d000 from 4 10000000:01000000:1.0:1788725824.267641:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788725824.267672:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.267688:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.267699:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725824.267718:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.267768:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.267807:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.267859:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436032 00000100:00100000:0.0:1788725824.267865:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436032 00000100:00100000:0.0:1788725824.267912:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788725824.267921:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791436032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725824.267933:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725824.267946:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36eef expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.267966:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36eef expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.268170:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36eef expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.268188:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6afa00, rc 0) 00000100:00100000:0.0:1788725824.268289:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.268296:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788725824.278188:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725824.278217:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725824.278230:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725824.278344:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.278404:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725824.278448:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.278548:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436160 00000100:00100000:0.0:1788725824.278556:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436160 00000100:00100000:0.0:1788725824.278601:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788725824.278611:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.278739:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.278746:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788725824.280354:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.280412:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.280485:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725824.280531:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725824.280554:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436288 00000100:00100000:2.0:1788725824.280560:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436288 00000100:00100000:2.0:1788725824.280603:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788725824.280610:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.280716:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725824.280722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788725824.280761:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.281381:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10401:1875614791436416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725824.281423:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725824.281460:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13848546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725824.281755:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436416 00000100:00100000:2.0:1788725824.281760:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436416 00000100:00100000:2.0:1788725824.281796:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788725824.281804:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10401:x1875614791436416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725824.291758:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10401:x1875614791436416:12345-0@lo:502:llog_process_th.0 Request processed in 9943us (10324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.291774:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788725824.291979:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10401:1875614791436416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788725824.292018:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725824.292028:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725824.292031:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788725824.292045:0:10401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139e52d000 00000020:00000080:2.0:1788725824.292047:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788725824.292172:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10401:1875614791436544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725824.292218:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725824.292250:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436544 00000100:00100000:2.0:1788725824.292256:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436544 00000100:00100000:2.0:1788725824.292304:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788725824.292313:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10401:x1875614791436544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725824.292409:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:10401:x1875614791436544:12345-0@lo:502:llog_process_th.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725824.292416:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788725824.292455:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725824.292469:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10401:1875614791436544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788725824.292487:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725824.292491:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725824.292492:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788725824.292496:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788725824.292564:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788725824.292584:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725824.292593:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725824.292602:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725824.292612:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725824.292614:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b13bd660800 from 4 10000000:01000000:2.0:1788725824.292616:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725824.292638:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725824.292652:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725824.292662:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725824.292676:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725824.292702:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725824.292717:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.301815:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436672 00000100:00100000:0.0:1788725824.301890:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436672 00000100:00100000:0.0:1788725824.305170:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788725824.305191:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791436672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725824.305208:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725824.305423:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36efd expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.305472:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36efd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.305483:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36efd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.305492:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af000, rc 0) 00000100:00100000:0.0:1788725824.305628:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791436672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (12923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.305635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788725824.309050:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725824.309081:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725824.309094:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725824.309225:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725824.309293:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725824.309336:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.309899:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436800 00000100:00100000:1.0:1788725824.309908:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436800 00000100:00100000:1.0:1788725824.309965:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788725824.309974:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791436800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.310114:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791436800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.310137:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788725824.310696:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.310757:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.310834:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725824.310881:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854900 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.310928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791436928 00000100:00100000:1.0:1788725824.310934:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791436928 00000100:00100000:1.0:1788725824.310986:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788725824.310994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791436928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.311096:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791436928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.311103:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788725824.311316:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791436928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.311990:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10403:1875614791437056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725824.312027:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725824.312054:0:10403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13848543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.312142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437056 00000100:00100000:1.0:1788725824.312147:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437056 00000100:00100000:1.0:1788725824.312171:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788725824.312185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10403:x1875614791437056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.312257:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10403:x1875614791437056:12345-0@lo:502:llog_process_th.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.312275:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788725824.312348:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10403:1875614791437056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725824.312367:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725824.312376:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725824.312378:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788725824.312389:0:10403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b13bd660800 00000020:00000080:0.0:1788725824.312391:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788725824.312467:0:10403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10403:1875614791437184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725824.312501:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725824.312526:0:10403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13848543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725824.312671:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437184 00000100:00100000:1.0:1788725824.312675:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437184 00000100:00100000:1.0:1788725824.312707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788725824.312713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10403:x1875614791437184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.312779:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:10403:x1875614791437184:12345-0@lo:502:llog_process_th.0 Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725824.312786:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788725824.313102:0:10403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10403:1875614791437184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725824.313163:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725824.313169:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725824.313171:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788725824.313179:0:10403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788725824.313358:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788725824.313384:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788725824.313395:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.313407:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725824.313418:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788725824.313421:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139116a000 from 4 10000000:01000000:1.0:1788725824.313423:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788725824.313453:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.313461:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.313471:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725824.313498:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.313536:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.313569:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.313956:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437312 00000100:00100000:0.0:1788725824.313962:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437312 00000100:00100000:0.0:1788725824.314896:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788725824.314907:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791437312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725824.314923:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725824.314941:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36f0b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.315708:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36f0b expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.315728:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f0b expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.315737:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af600, rc 0) 00000100:00100000:0.0:1788725824.316935:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791437312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2023us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.316945:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788725824.317553:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725824.317581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.317595:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725824.317692:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.317742:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.317778:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.318007:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437440 00000100:00100000:0.0:1788725824.318014:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437440 00000100:00100000:0.0:1788725824.318063:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788725824.318074:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791437440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.318249:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791437440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.318257:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788725824.318358:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725824.318393:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725824.318438:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725824.318466:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725824.319897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437568 00000100:00100000:0.0:1788725824.319906:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437568 00000100:00100000:0.0:1788725824.319951:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788725824.319960:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791437568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725824.321231:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791437568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1268us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725824.321240:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788725824.321529:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791437568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725824.336289:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10404:1875614791437696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.336372:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.336425:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725824.336485:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437696 00000100:00100000:3.0:1788725824.336493:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437696 00000100:00100000:3.0:1788725824.336542:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788725824.336551:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:10404:x1875614791437696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725824.336687:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:10404:x1875614791437696:12345-0@lo:502:llog_process_th.0 Request processed in 136us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725824.336695:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788725824.337086:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10404:1875614791437696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725824.337147:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725824.337157:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725824.337160:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788725824.337168:0:10404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139116a000 00000020:00000080:1.0:1788725824.337171:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725824.337271:0:10404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10404:1875614791437824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725824.337315:0:10404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725824.337332:0:10404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725824.337421:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437824 00000100:00100000:3.0:1788725824.337426:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437824 00000100:00100000:3.0:1788725824.337453:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788725824.337462:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:10404:x1875614791437824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725824.337540:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:10404:x1875614791437824:12345-0@lo:502:llog_process_th.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725824.337546:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788725824.337896:0:10404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:10404:1875614791437824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725824.337930:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725824.337936:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725824.337937:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788725824.337941:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788725824.338485:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788725824.338508:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788725824.338517:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725824.338528:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725824.386334:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725825.148551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791437952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725825.148617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725825.148713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791437952 00000100:00100000:2.0:1788725825.148720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791437952 00000100:00100000:2.0:1788725825.148881:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788725825.148892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791437952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725825.148930:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725825.148980:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791437952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725825.148987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788725825.149049:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791437952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725825.280361:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725825.280411:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770403968 00000100:00100000:0.0:1788725825.280421:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770403968 00000100:00100000:0.0:1788725825.280472:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:0.0:1788725825.280482:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+9:6168:x1875614770403968:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725825.280499:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725825.280524:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6cd0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725825.280551:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725825.280563:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725825.280573:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af200, rc 0) 00000100:00100000:0.0:1788725825.280629:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770403968:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 147us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725825.280637:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:0.0:1788725825.286970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725825.287002:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404096 00000100:00100000:0.0:1788725825.287011:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404096 00000100:00100000:0.0:1788725825.287054:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:0.0:1788725825.287064:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770404096:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725825.287230:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770404096:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 167us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725825.287239:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:0.0:1788725825.290553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725825.290898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404224 00000100:00100000:3.0:1788725825.290909:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404224 00000100:00100000:3.0:1788725825.290969:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:3.0:1788725825.290979:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770404224:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725825.291140:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6168:x1875614770404224:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 134us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725825.291149:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:3.0:1788725825.299900:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725825.299934:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404352 00000100:00100000:3.0:1788725825.299942:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404352 00000100:00100000:3.0:1788725825.299989:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:3.0:1788725825.299999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6715:x1875614770404352:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788725825.300171:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6715:x1875614770404352:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 172us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725825.300180:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 273 00000100:00100000:0.0:1788725825.311651:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725825.311688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404480 00000100:00100000:0.0:1788725825.311696:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404480 00000100:00100000:0.0:1788725825.311745:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 274 00000100:00100000:0.0:1788725825.311755:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6715:x1875614770404480:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788725825.311914:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:6715:x1875614770404480:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 159us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725825.311922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 274 00010000:00010000:3.0:1788725825.406597:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725825.659720:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725825.659741:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791438080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725825.659986:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791438208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725825.660344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725825.660598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725825.660681:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438208 00000100:00100000:2.0:1788725825.660688:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438208 00000100:00100000:2.0:1788725825.660763:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438080 00000100:00100000:2.0:1788725825.660766:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438080 00000100:00080000:3.0:1788725825.660917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725825.660951:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788725825.660962:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791438208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725825.660989:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725825.661047:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791438208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725825.661054:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788725825.661388:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bb100 x1875614791438208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725825.661408:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791438208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725825.662346:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788725825.662356:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791438080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725825.662373:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725825.662435:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791438080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725825.662442:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788725825.662479:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af861500 x1875614791438080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725825.662495:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791438080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725826.242231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725826.242278:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725826.242301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725826.242324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725826.244184:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404608 00000100:00100000:3.0:1788725826.244197:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404608 00000100:00100000:3.0:1788725826.244263:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:3.0:1788725826.244274:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2396:x1875614770404608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725826.244348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2396:x1875614770404608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725826.244355:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 275 00000100:00100000:1.0:1788725826.244620:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725826.244654:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404864 00000100:00100000:1.0:1788725826.244659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404864 00000100:00100000:1.0:1788725826.244700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404736 00000100:00100000:1.0:1788725826.244704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404736 00000100:00100000:1.0:1788725826.244727:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1788725826.244735:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770404864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725826.244791:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770404864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725826.244799:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1788725826.244813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788725826.244820:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770404736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725826.244845:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770404736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725826.244851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788725826.244871:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405120 00000100:00100000:1.0:1788725826.244875:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405120 00000100:00100000:1.0:1788725826.244901:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770404992 00000100:00100000:1.0:1788725826.244905:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770404992 00000100:00100000:1.0:1788725826.244926:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788725826.244932:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770405120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725826.244958:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770405120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725826.244964:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788725826.244973:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788725826.244979:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770404992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725826.244998:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770404992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725826.245003:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00080000:1.0:1788725826.245024:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725826.245028:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725826.245030:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725826.245037:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788725826.435975:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725827.451690:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725827.707647:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725827.707671:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791438336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725827.707739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725827.707821:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438336 00000100:00100000:2.0:1788725827.707829:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438336 00000100:00100000:2.0:1788725827.707884:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788725827.707894:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791438336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725827.707923:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725827.707969:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791438336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725827.707976:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788725827.707999:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788725827.708041:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bb480 x1875614791438336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725827.708061:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791438336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725827.708510:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725827.708521:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791438464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725827.708552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725827.708583:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438464 00000100:00100000:2.0:1788725827.708587:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438464 00000100:00100000:2.0:1788725827.708627:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788725827.708635:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791438464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725827.708647:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725827.708677:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791438464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725827.708684:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788725827.708698:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788725827.708716:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bb480 x1875614791438464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725827.708731:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791438464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725827.710626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791438592:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.710684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725827.710775:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438592 00000100:00100000:0.0:1788725827.710783:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438592 00000100:00100000:0.0:1788725827.710836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788725827.710845:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791438592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.710892:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791438592:12345-0@lo:400:kworker.0 Request processed in 49us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.710899:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788725827.711042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791438592:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.714261:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791438720:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.714329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725827.715168:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438720 00000100:00100000:0.0:1788725827.715178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438720 00000100:00100000:0.0:1788725827.715231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725827.715251:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791438720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725827.716037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791438976:0@lo:400:kworker.0 00000100:00100000:1.0:1788725827.716078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725827.716321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791438720:12345-0@lo:400:kworker.0 Request processed in 1080us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.716329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725827.716349:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438976 00000100:00100000:0.0:1788725827.716355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438976 00000100:00100000:0.0:1788725827.716384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788725827.716391:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791438976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716518:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791438848:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725827.716566:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791439360:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725827.716591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791439872:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725827.716623:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788725827.716628:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791439232:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725827.716652:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791439744:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725827.716685:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791438848 00000100:00100000:3.0:1788725827.716696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791438848 00000100:00100000:3.0:1788725827.716726:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788725827.716734:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791438848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.716771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791438848:12345-0@lo:400:kworker.0 Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725827.716778:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788725827.716896:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791438720:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.716923:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791439104:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.716950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725827.716968:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791439616:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.716993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725827.717026:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725827.717032:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791439488:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.717054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725827.717081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439104 00000100:00100000:2.0:1788725827.717092:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439104 00000100:00100000:2.0:1788725827.717132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788725827.717140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791439104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.717179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791439104:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725827.717185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788725827.717205:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439616 00000100:00100000:2.0:1788725827.717209:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439616 00000100:00100000:2.0:1788725827.717253:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439488 00000100:00100000:2.0:1788725827.717256:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439488 00000100:00100000:2.0:1788725827.717278:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725827.717284:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791439616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.717317:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791439616:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725827.717323:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725827.717335:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788725827.717341:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791439488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.717363:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791439488:12345-0@lo:400:kworker.0 Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725827.717368:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788725827.717390:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725827.717408:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be825c00 x1875614791439488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725827.717419:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791439488:0@lo:400:kworker.0 00000100:00100000:2.0:1788725827.717427:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791439104:0@lo:400:kworker.0 00010000:00080000:2.0:1788725827.717434:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be824700 x1875614791439616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725827.717450:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791439616:0@lo:400:kworker.0 00000100:00100000:3.0:1788725827.719080:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791438848:0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.719962:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791438976:12345-0@lo:400:kworker.0 Request processed in 3565us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.719975:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788725827.720012:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439360 00000100:00100000:0.0:1788725827.720020:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439360 00000100:00100000:0.0:1788725827.720069:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439872 00000100:00100000:0.0:1788725827.720072:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439872 00000100:00100000:0.0:1788725827.720086:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439232 00000100:00100000:0.0:1788725827.720089:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439232 00000100:00100000:0.0:1788725827.720099:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791439744 00000100:00100000:0.0:1788725827.720102:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791439744 00000100:00100000:0.0:1788725827.720137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725827.720147:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791439360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.720215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791439360:12345-0@lo:400:kworker.0 Request processed in 69us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.720221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788725827.720235:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788725827.720255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791439872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.720285:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791439872:12345-0@lo:400:kworker.0 Request processed in 31us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.720291:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788725827.720304:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788725827.720310:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791439232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.720338:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791439232:12345-0@lo:400:kworker.0 Request processed in 29us (3693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.720344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788725827.720355:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788725827.720361:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791439744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.720385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791439744:12345-0@lo:400:kworker.0 Request processed in 25us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725827.720391:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788725827.720416:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725827.720427:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725827.720457:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791439232:0@lo:400:kworker.0 00000100:00100000:0.0:1788725827.720468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791439744:0@lo:400:kworker.0 00010000:00080000:0.0:1788725827.720481:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827800 x1875614791439360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725827.720492:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791439360:0@lo:400:kworker.0 00010000:00080000:0.0:1788725827.720501:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827480 x1875614791439872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725827.720508:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791439872:0@lo:400:kworker.0 00000100:00100000:1.0:1788725827.722345:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791438976:0@lo:400:kworker.0 00010000:00010000:3.0:1788725828.477576:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725828.732257:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725828.732280:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791440000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725828.732344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725828.732409:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440000 00000100:00100000:2.0:1788725828.732416:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440000 00000100:00100000:2.0:1788725828.732454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788725828.732462:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791440000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725828.732490:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725828.732532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791440000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725828.732539:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788725828.732582:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791440000:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788725829.500234:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788725830.079365:0:10686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788725830.268996:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791440128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725830.269070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725830.269241:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440128 00000100:00100000:1.0:1788725830.269248:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440128 00000100:00100000:1.0:1788725830.269308:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788725830.269320:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791440128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725830.269355:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725830.269631:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791440128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 312us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725830.269639:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788725830.269890:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791440128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725830.523443:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725830.787600:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791440256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725830.787668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725830.787755:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440256 00000100:00100000:2.0:1788725830.787762:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440256 00000100:00100000:2.0:1788725830.787812:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725830.787822:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791440256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725830.787849:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725830.787892:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791440256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725830.787899:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788725830.787921:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725830.787949:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b8700 x1875614791440256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725830.787974:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791440256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725830.790757:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791440384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725830.790824:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725830.795206:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440384 00000100:00100000:2.0:1788725830.795229:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440384 00000100:00100000:2.0:1788725830.795327:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788725830.795337:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791440384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725830.795363:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725830.795443:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791440384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725830.795451:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788725830.795505:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d9f80 x1875614791440384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725830.795525:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791440384:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788725830.795658:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725831.357172:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725831.357222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725831.357258:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725831.357288:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725831.357315:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725831.357345:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405504 00000100:00100000:0.0:1788725831.357353:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405504 00000100:00100000:0.0:1788725831.357408:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405376 00000100:00100000:0.0:1788725831.357412:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405376 00000100:00100000:0.0:1788725831.357438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788725831.357450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405504:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725831.357519:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405504:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725831.357527:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788725831.357545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788725831.357565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770405376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725831.357594:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770405376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725831.357601:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788725831.357622:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405760 00000100:00100000:0.0:1788725831.357625:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405760 00000100:00100000:0.0:1788725831.357650:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405632 00000100:00100000:0.0:1788725831.357653:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405632 00000100:00100000:0.0:1788725831.357673:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788725831.357680:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725831.357708:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725831.357714:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788725831.357727:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788725831.357734:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1788725831.357869:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725831.357873:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725831.357875:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725831.357877:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725831.358375:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405248 00000100:00100000:3.0:1788725831.358381:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405248 00000100:00100000:3.0:1788725831.358420:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 277 00000100:00100000:3.0:1788725831.358429:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770405248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725831.358770:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770405632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1035us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725831.358778:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788725831.365529:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770405248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 7088us (8353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725831.365546:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 277 00010000:00010000:1.0:1788725831.548524:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725832.577141:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725832.827586:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791440768:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827714:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791441280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827756:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791441792:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827795:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791442304:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827844:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788725832.827850:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791440640:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827893:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791441152:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827914:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827930:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791441664:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.827961:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791442176:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.827992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791440896:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828082:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791441536:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828145:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791441920:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828166:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828184:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788725832.828190:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791441024:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828238:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791441408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725832.828245:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725832.828254:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791440512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725832.828258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828275:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791442048:0@lo:400:kworker.0 00000100:00100000:2.0:1788725832.828279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725832.828319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440768 00000100:00100000:1.0:1788725832.828331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440768 00000100:00100000:2.0:1788725832.828390:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440640 00000100:00100000:2.0:1788725832.828394:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440640 00000100:00100000:1.0:1788725832.828496:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441280 00000100:00100000:2.0:1788725832.828500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788725832.828500:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441280 00000100:00100000:2.0:1788725832.828510:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791440640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828522:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441536 00000100:00100000:1.0:1788725832.828524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441536 00000100:00100000:1.0:1788725832.828534:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441920 00000100:00100000:1.0:1788725832.828536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441920 00000100:00100000:1.0:1788725832.828548:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441024 00000100:00100000:1.0:1788725832.828550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441024 00000100:00100000:1.0:1788725832.828560:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442048 00000100:00100000:1.0:1788725832.828562:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442048 00000100:00100000:2.0:1788725832.828571:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791440640:12345-0@lo:400:kworker.0 Request processed in 62us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725832.828574:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788725832.828578:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788725832.828580:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791440768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791440768:12345-0@lo:400:kworker.0 Request processed in 33us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725832.828615:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441408 00000100:00100000:2.0:1788725832.828619:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441408 00000100:00100000:1.0:1788725832.828620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788725832.828632:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788725832.828636:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440512 00000100:00100000:1.0:1788725832.828637:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791441280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725832.828638:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440512 00000100:00100000:2.0:1788725832.828650:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788725832.828655:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791441408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725832.828662:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791441280:12345-0@lo:400:kworker.0 Request processed in 25us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725832.828666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00002000:00000024:2.0:1788725832.828676:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725832.828676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725832.828681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791441536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.828707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791441536:12345-0@lo:400:kworker.0 Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725832.828712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725832.828723:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788725832.828729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791441920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.828817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788725832.828826:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791441024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725832.828855:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791441408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.828857:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791441024:12345-0@lo:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725832.828863:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788725832.828863:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788725832.828876:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788725832.828876:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788725832.828883:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791440512:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725832.828883:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791442048:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788725832.828893:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725832.828914:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791442048:12345-0@lo:400:kworker.0 Request processed in 32us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725832.828916:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791440512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.828921:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788725832.828922:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788725832.828954:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b9f80 x1875614791440512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725832.828973:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791440512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725832.829169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441152 00000100:00100000:0.0:1788725832.829174:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441152 00000100:00100000:0.0:1788725832.829199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791440896 00000100:00100000:0.0:1788725832.829214:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791440896 00000100:00100000:0.0:1788725832.829230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788725832.829237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791441152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829271:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791441152:12345-0@lo:400:kworker.0 Request processed in 35us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788725832.829291:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725832.829309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791440896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791440896:12345-0@lo:400:kworker.0 Request processed in 29us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725832.829360:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441792 00000100:00100000:0.0:1788725832.829364:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441792 00000100:00100000:0.0:1788725832.829383:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442304 00000100:00100000:0.0:1788725832.829385:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442304 00000100:00100000:0.0:1788725832.829394:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791441664 00000100:00100000:0.0:1788725832.829396:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791441664 00000100:00100000:0.0:1788725832.829407:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442176 00000100:00100000:0.0:1788725832.829409:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442176 00000100:00100000:0.0:1788725832.829421:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725832.829427:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791441792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829473:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791441792:12345-0@lo:400:kworker.0 Request processed in 45us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829486:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725832.829497:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725832.829503:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791442304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829532:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791442304:12345-0@lo:400:kworker.0 Request processed in 29us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829538:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725832.829560:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725832.829567:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829593:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791441664:12345-0@lo:400:kworker.0 Request processed in 27us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829600:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788725832.829610:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788725832.829617:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791442176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725832.829640:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791442176:12345-0@lo:400:kworker.0 Request processed in 24us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725832.829646:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788725832.830465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791441920:12345-0@lo:400:kworker.0 Request processed in 1729us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725832.830477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788725832.830504:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725832.830508:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725832.830511:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725832.830513:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725832.830545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791441024:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830560:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387634e00 x1875614791441408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830576:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791441408:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788725832.830589:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346dc00 x1875614791442048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830598:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791442048:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830610:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791440896:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830620:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346e300 x1875614791441536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830629:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791441536:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791441920:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830679:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791440640:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791441152:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830701:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346d500 x1875614791441664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830718:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791441664:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830731:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346c000 x1875614791442176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830739:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791442176:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830750:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791440768:0@lo:400:kworker.0 00000100:00100000:1.0:1788725832.830760:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791441280:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830771:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346d880 x1875614791441792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830779:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791441792:0@lo:400:kworker.0 00010000:00080000:1.0:1788725832.830788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346df80 x1875614791442304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725832.830795:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791442304:0@lo:400:kworker.0 00010000:00010000:1.0:1788725833.595312:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725833.851280:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725833.851300:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791442432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725833.851365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725833.851431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442432 00000100:00100000:2.0:1788725833.851438:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442432 00000100:00100000:2.0:1788725833.851477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788725833.851485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791442432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725833.851523:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725833.851564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791442432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725833.851572:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788725833.851609:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791442432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788725834.619266:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725834.625240:0:10930:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing yml_node 00000100:00100000:3.0:1788725835.389799:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791442560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725835.389877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725835.389956:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442560 00000100:00100000:1.0:1788725835.389963:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442560 00000100:00100000:1.0:1788725835.390297:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788725835.390309:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791442560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725835.390344:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725835.390415:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791442560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725835.390423:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788725835.391254:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791442560:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725835.646501:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725835.899384:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791442688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725835.899452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725835.899514:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442688 00000100:00100000:2.0:1788725835.899522:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442688 00000100:00100000:2.0:1788725835.899586:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788725835.899596:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791442688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725835.899632:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725835.899677:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791442688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725835.899685:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788725835.899882:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725835.899972:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827480 x1875614791442688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725835.899989:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791442688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725835.900319:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725835.900333:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791442816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725835.900364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725835.900454:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442816 00000100:00100000:1.0:1788725835.900459:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442816 00000100:00100000:1.0:1788725835.900506:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788725835.900514:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791442816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725835.900526:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725835.900562:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791442816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725835.900569:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788725835.900595:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d8000 x1875614791442816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725835.900608:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791442816:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788725835.900662:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725836.482001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725836.482046:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725836.482093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725836.482171:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725836.482249:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725836.484331:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406144 00000100:00100000:0.0:1788725836.484346:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406144 00000100:00080000:3.0:1788725836.484418:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725836.484420:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406016 00000100:00100000:0.0:1788725836.484423:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406016 00000100:00080000:3.0:1788725836.484438:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725836.484533:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788725836.484545:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770406144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725836.484551:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788725836.484560:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770406016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725836.484606:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770405888 00000100:00100000:1.0:1788725836.484610:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770405888 00000100:00100000:3.0:1788725836.484621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770406016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 64us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725836.484628:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1788725836.484637:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:1.0:1788725836.484643:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770405888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725836.484674:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406272 00000100:00100000:3.0:1788725836.484678:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406272 00000100:00100000:2.0:1788725836.484696:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406400 00000100:00100000:2.0:1788725836.484700:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406400 00000100:00100000:3.0:1788725836.484723:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788725836.484727:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788725836.484729:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13beba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770406272:12345-192.168.203.12@tcp:9:kworker.0 00000100:00100000:2.0:1788725836.484733:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770406400:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788725836.484753:0:8716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36e2b 00000020:00000080:2.0:1788725836.484753:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36e32 00000100:00080000:3.0:1788725836.484761:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b12834b2000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788725836.484761:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b12834b6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788725836.484801:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000001:00000004:3.0:1788725836.484968:0:8716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788725836.485882:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770406144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1335us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725836.485892:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788725836.486799:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770405888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2150us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725836.486810:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 279 00010000:00010000:1.0:1788725836.486979:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725836.490569:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+2:2394:x1875614770406400:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 5824us (8308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725836.490583:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:2.0:1788725836.490653:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788725836.490811:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725836.490817:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725836.498347:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13beba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+2:2394:x1875614770406272:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 13605us (16163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725836.498363:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:3.0:1788725836.672199:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725837.691423:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725837.947553:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725837.947590:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791442944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725837.947658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.949584:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791443072:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.949646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.949686:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725837.949692:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791443200:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.949719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.949746:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791443456:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.949792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.949812:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725837.949818:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791443328:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.950396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.950440:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443328 00000100:00100000:1.0:1788725837.950448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443328 00000100:00100000:1.0:1788725837.950503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788725837.950513:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791443328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.950580:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791442944 00000100:00100000:2.0:1788725837.950586:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791442944 00000100:00100000:2.0:1788725837.950627:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725837.950635:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791442944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725837.950657:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725837.950696:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791442944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.950704:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788725837.950730:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725837.950757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443072 00000100:00100000:2.0:1788725837.950761:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443072 00000100:00100000:1.0:1788725837.950793:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791443328:12345-0@lo:400:kworker.0 Request processed in 280us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.950804:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788725837.950804:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788725837.950817:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791443072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.950870:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791443072:12345-0@lo:400:kworker.0 Request processed in 56us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.950875:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788725837.950917:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791443328:0@lo:400:kworker.0 00010000:00080000:2.0:1788725837.950923:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be825500 x1875614791442944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725837.950943:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791442944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725837.950959:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791443072:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.950985:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443200 00000100:00100000:1.0:1788725837.950989:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443200 00000100:00100000:2.0:1788725837.951007:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443456 00000100:00100000:2.0:1788725837.951013:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443456 00000100:00100000:1.0:1788725837.951026:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788725837.951036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791443200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.951073:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791443200:12345-0@lo:400:kworker.0 Request processed in 40us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725837.951080:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788725837.951105:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791443200:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951298:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791443712:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725837.951360:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791444224:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725837.951395:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788725837.951400:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791443584:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725837.951443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791444096:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725837.951499:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444096 00000100:00100000:3.0:1788725837.951503:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444096 00000100:00100000:3.0:1788725837.951536:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788725837.951543:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791444096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.951578:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443712 00000100:00100000:2.0:1788725837.951584:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443712 00000100:00100000:3.0:1788725837.951596:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791444096:12345-0@lo:400:kworker.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.951601:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444224 00000100:00100000:3.0:1788725837.951606:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725837.951606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444224 00000100:00080000:3.0:1788725837.951630:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725837.951633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788725837.951636:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725837.951644:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791443456:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788725837.951658:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2aa00 x1875614791444096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725837.951669:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791444096:0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.951690:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791443456:12345-0@lo:400:kworker.0 Request processed in 48us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.951698:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788725837.951704:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791443840:0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.951714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725837.951722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791443712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.951736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.952180:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791443968:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.952246:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791444352:0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.952270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725837.952317:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443584 00000100:00100000:3.0:1788725837.952322:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443584 00000100:00100000:3.0:1788725837.952349:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788725837.952357:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791443584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.952396:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791443584:12345-0@lo:400:kworker.0 Request processed in 39us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725837.952402:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788725837.952428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443840 00000100:00100000:3.0:1788725837.952432:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443840 00000100:00100000:3.0:1788725837.952454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444352 00000100:00100000:3.0:1788725837.952457:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444352 00000100:00100000:3.0:1788725837.952472:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788725837.952478:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791444224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725837.952510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791444224:12345-0@lo:400:kworker.0 Request processed in 32us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725837.952516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788725837.952528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788725837.952534:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791443840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.952578:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791443712:12345-0@lo:400:kworker.0 Request processed in 855us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725837.952586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791443840:12345-0@lo:400:kworker.0 Request processed in 51us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725837.952588:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788725837.952598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788725837.952609:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788725837.952620:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791444352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788725837.952622:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725837.952647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791443584:0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.952659:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791444352:12345-0@lo:400:kworker.0 Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725837.952665:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791443712:0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.952670:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788725837.952683:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791444224:0@lo:400:kworker.0 00010000:00080000:2.0:1788725837.952717:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a28e00 x1875614791443840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725837.952729:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791443840:0@lo:400:kworker.0 00010000:00080000:2.0:1788725837.952757:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2a300 x1875614791444352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725837.952766:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791444352:0@lo:400:kworker.0 00000100:00100000:2.0:1788725837.954523:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791444608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725837.954580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725837.954925:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444608 00000100:00100000:0.0:1788725837.954935:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444608 00000100:00100000:0.0:1788725837.955065:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788725837.955074:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791444608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725837.955093:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725837.955158:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791444608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725837.955181:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725837.956328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.956377:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791444480:0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.956424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725837.956465:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791443456:0@lo:400:kworker.0 00000100:00100000:0.0:1788725837.956679:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791443968 00000100:00100000:0.0:1788725837.956685:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791443968 00000100:00100000:1.0:1788725837.956725:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444480 00000100:00100000:1.0:1788725837.956729:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444480 00000100:00100000:1.0:1788725837.956769:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788725837.956778:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791444480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725837.956834:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791444480:12345-0@lo:400:kworker.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725837.956849:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788725837.956880:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2b800 x1875614791444480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725837.956891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791444480:0@lo:400:kworker.0 00010000:00080000:2.0:1788725837.959228:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387636680 x1875614791444608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725837.959265:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791444608:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788725837.959665:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788725837.959672:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725837.967053:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788725837.967080:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791443968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725837.967204:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791443968:12345-0@lo:400:kworker.0 Request processed in 138us (10878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725837.967212:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788725837.967399:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2b480 x1875614791443968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725837.967415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791443968:0@lo:400:kworker.0 00010000:00010000:0.0:1788725838.716348:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725838.973322:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725838.973342:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791444736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725838.973407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725838.973654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444736 00000100:00100000:2.0:1788725838.973661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444736 00000100:00100000:2.0:1788725838.973706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725838.973713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791444736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725838.973747:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725838.973785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791444736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725838.973792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725838.973829:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791444736:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788725839.264691:0:11114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:3.0:1788725839.739432:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725840.507472:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725840.507513:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791444864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725840.507607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725840.507692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444864 00000100:00100000:2.0:1788725840.507712:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444864 00000100:00100000:2.0:1788725840.507768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788725840.507779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791444864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725840.507824:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725840.507896:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791444864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725840.507904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788725840.507963:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791444864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725840.765088:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725841.021320:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725841.021354:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791444992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725841.021448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725841.021721:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791444992 00000100:00100000:3.0:1788725841.021732:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791444992 00000100:00100000:3.0:1788725841.021818:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788725841.021832:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791444992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788725841.021870:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725841.021945:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791444992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725841.021953:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788725841.022026:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725841.022102:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af865f80 x1875614791444992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725841.022145:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791444992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725841.022391:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725841.022409:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791445120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725841.022441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725841.022647:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445120 00000100:00100000:3.0:1788725841.022652:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445120 00000100:00100000:3.0:1788725841.022700:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788725841.022709:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791445120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725841.022722:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725841.022766:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791445120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725841.022773:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788725841.022864:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725841.024867:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827800 x1875614791445120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725841.024905:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791445120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725841.598869:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725841.598930:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725841.598970:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725841.599177:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406528 00000100:00100000:3.0:1788725841.599191:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406528 00000100:00100000:3.0:1788725841.599256:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:3.0:1788725841.599269:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770406528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725841.599356:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770406528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 90us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725841.599365:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:2.0:1788725841.599474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406784 00000100:00100000:2.0:1788725841.599480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406784 00000100:00100000:2.0:1788725841.599527:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406656 00000100:00100000:2.0:1788725841.599530:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406656 00000100:00100000:2.0:1788725841.599551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788725841.599559:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770406784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725841.599598:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770406784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725841.599617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788725841.599637:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1788725841.599644:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770406656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725841.599668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770406656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725841.599674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00080000:3.0:1788725841.601376:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725841.601390:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788725841.794102:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788725842.049996:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:1.0:1788725842.050007:0:8420:0:(genops.c:885:class_export_put()) final put ffff9b12834b7800/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:2.0:1788725842.050102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12834b7800/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-OST0000 00000020:00000080:2.0:1788725842.050241:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12834b2000 for lustre-OST0000 00000001:00100000:3.0:1788725842.050837:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:3.0:1788725842.050843:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b12834b5800/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:2.0:1788725842.050927:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12834b5800/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-OST0001 00000020:00000080:2.0:1788725842.050968:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12834b6000 for lustre-OST0001 00000001:02000400:3.0:1788725842.312655:0:11211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:2.0:1788725842.813087:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725843.067364:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725843.067392:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791445248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725843.067486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725843.068313:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445248 00000100:00100000:3.0:1788725843.068326:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445248 00000100:00100000:3.0:1788725843.068418:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788725843.068432:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791445248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725843.068495:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725843.068570:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791445248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725843.068577:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788725843.068610:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788725843.068650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827800 x1875614791445248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725843.068674:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791445248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725843.069689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791445504:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.069789:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791446016:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.069833:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791446528:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.069871:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788725843.069875:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791445376:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.069916:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791445888:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069936:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.069954:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791446400:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.069977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070022:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791445760:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070067:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791446272:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791446784:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070165:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070186:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788725843.070192:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791445632:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070251:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791446144:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070452:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070466:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791446656:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725843.070576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445504 00000100:00100000:2.0:1788725843.070585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445504 00000100:00100000:2.0:1788725843.070627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446016 00000100:00100000:2.0:1788725843.070630:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446016 00000100:00100000:2.0:1788725843.070652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446528 00000100:00100000:2.0:1788725843.070655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446528 00000100:00100000:2.0:1788725843.070668:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445760 00000100:00100000:2.0:1788725843.070671:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445760 00000100:00100000:2.0:1788725843.070681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446144 00000100:00100000:2.0:1788725843.070683:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446144 00000100:00100000:2.0:1788725843.070694:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446656 00000100:00100000:2.0:1788725843.070696:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446656 00000100:00100000:2.0:1788725843.070711:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788725843.070720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791445504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070777:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791445504:12345-0@lo:400:kworker.0 Request processed in 57us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725843.070784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788725843.070803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788725843.070809:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791446016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791446016:12345-0@lo:400:kworker.0 Request processed in 28us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725843.070842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788725843.070852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788725843.070867:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791446528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070897:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791446528:12345-0@lo:400:kworker.0 Request processed in 30us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725843.070903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788725843.070916:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788725843.070922:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791445760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.070957:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791445760:12345-0@lo:400:kworker.0 Request processed in 34us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725843.070963:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788725843.070975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788725843.070981:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791446144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788725843.071172:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725843.071178:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725843.071249:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446400 00000100:00100000:0.0:1788725843.071255:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446400 00000100:00100000:0.0:1788725843.071310:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446272 00000100:00100000:0.0:1788725843.071314:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446272 00000100:00100000:0.0:1788725843.071330:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446784 00000100:00100000:0.0:1788725843.071333:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446784 00000100:00100000:0.0:1788725843.071350:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788725843.071357:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725843.071393:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791446400:12345-0@lo:400:kworker.0 Request processed in 38us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725843.071399:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788725843.071411:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725843.071416:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791446272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725843.071437:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791446272:12345-0@lo:400:kworker.0 Request processed in 21us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725843.071442:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788725843.071449:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788725843.071453:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791446784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725843.071473:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791446784:12345-0@lo:400:kworker.0 Request processed in 20us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725843.071490:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788725843.071642:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725843.071646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725843.071743:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445888 00000100:00100000:3.0:1788725843.071748:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445888 00000100:00100000:3.0:1788725843.071786:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445632 00000100:00100000:3.0:1788725843.071790:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445632 00000100:00100000:3.0:1788725843.071805:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788725843.071813:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791445888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725843.071854:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791445888:12345-0@lo:400:kworker.0 Request processed in 42us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725843.071860:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788725843.071872:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788725843.071878:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791445632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725843.071903:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791445632:12345-0@lo:400:kworker.0 Request processed in 26us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725843.071909:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788725843.071925:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791445376 00000100:00100000:3.0:1788725843.071937:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791445376 00000100:00100000:3.0:1788725843.071962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788725843.071968:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791445376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725843.072068:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791445376:12345-0@lo:400:kworker.0 Request processed in 100us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725843.072074:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788725843.072107:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788725843.072114:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791446656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725843.072179:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791446656:12345-0@lo:400:kworker.0 Request processed in 65us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725843.072185:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788725843.072357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791446144:12345-0@lo:400:kworker.0 Request processed in 1374us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725843.072364:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788725843.072419:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791445632:0@lo:400:kworker.0 00010000:00080000:2.0:1788725843.072434:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842ad180 x1875614791446144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725843.072447:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791446144:0@lo:400:kworker.0 00010000:00080000:2.0:1788725843.072455:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823db100 x1875614791446656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725843.072465:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791446656:0@lo:400:kworker.0 00000100:00100000:3.0:1788725843.072656:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791446912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725843.072698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725843.072781:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791446912 00000100:00100000:0.0:1788725843.072786:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791446912 00000100:00100000:0.0:1788725843.072826:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788725843.072834:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791446912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725843.072850:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725843.072892:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791446912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725843.072909:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788725843.072968:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283687480 x1875614791446912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725843.072984:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791446912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725843.073064:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791445760:0@lo:400:kworker.0 00010000:00080000:2.0:1788725843.073079:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842ac700 x1875614791446272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725843.073094:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791446272:0@lo:400:kworker.0 00010000:00080000:2.0:1788725843.073105:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823d9880 x1875614791446784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725843.073112:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791446784:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.073196:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791445376:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.073209:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791445888:0@lo:400:kworker.0 00010000:00080000:2.0:1788725843.073222:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138422c700 x1875614791446400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725843.073231:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791446400:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.073244:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791445504:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.073255:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791446016:0@lo:400:kworker.0 00000100:00100000:2.0:1788725843.073746:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791446528:0@lo:400:kworker.0 00010000:00010000:1.0:1788725843.835539:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725844.091409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791447040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725844.091525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725844.091586:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447040 00000100:00100000:2.0:1788725844.091597:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447040 00000100:00100000:2.0:1788725844.091663:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788725844.091675:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791447040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725844.091720:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725844.091784:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791447040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725844.091792:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788725844.091840:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791447040:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788725844.744699:0:11308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:0.0:1788725844.859524:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725845.627655:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725845.627689:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791447168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725845.627784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725845.628048:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447168 00000100:00100000:2.0:1788725845.628059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447168 00000100:00100000:2.0:1788725845.628153:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788725845.628165:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791447168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725845.628210:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725845.628263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791447168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725845.628270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788725845.628436:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791447168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788725845.885252:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725846.139430:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791447296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725846.139582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725846.139661:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447296 00000100:00100000:0.0:1788725846.139669:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447296 00000100:00100000:0.0:1788725846.139729:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788725846.139740:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791447296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788725846.139772:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788725846.139884:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725846.139919:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833dbb80 x1875614791447296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725846.139938:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791447296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725846.140139:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725846.140151:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791447424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725846.143970:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725846.144095:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788725846.144107:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788725846.145080:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791447296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5336us (5495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725846.145092:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788725846.145525:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447424 00000100:00100000:0.0:1788725846.145535:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447424 00000100:00100000:0.0:1788725846.145595:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788725846.145605:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791447424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788725846.145631:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725846.145701:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791447424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725846.145717:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788725846.145855:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725846.146170:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833da680 x1875614791447424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725846.146204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791447424:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788725846.312823:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 16:17:24 EDT 2026 00000100:00100000:3.0:1788725846.717301:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725846.717347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725846.717384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725846.717749:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770406912 00000100:00100000:1.0:1788725846.717759:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770406912 00000100:00100000:1.0:1788725846.717819:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:1.0:1788725846.717829:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2395:x1875614770406912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725846.717888:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407168 00000100:00100000:2.0:1788725846.717893:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407168 00000100:00100000:1.0:1788725846.717913:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2395:x1875614770406912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 86us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725846.717920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 283 00000100:00100000:2.0:1788725846.717929:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407040 00000100:00100000:2.0:1788725846.717932:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407040 00000100:00100000:2.0:1788725846.717950:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1788725846.717957:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770407168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725846.717988:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770407168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725846.717994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1788725846.718007:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788725846.718026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770407040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:1.0:1788725846.718046:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725846.718051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725846.718056:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770407040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725846.718062:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00010000:00010000:1.0:1788725846.907447:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725847.940252:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725848.190375:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791447552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725848.190444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725848.190515:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447552 00000100:00100000:3.0:1788725848.190522:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447552 00000100:00100000:3.0:1788725848.190573:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725848.190582:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791447552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725848.190615:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725848.190719:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791447552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725848.190726:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788725848.190769:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af866a00 x1875614791447552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725848.190786:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791447552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725848.190904:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791447680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725848.190928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725848.190985:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447680 00000100:00100000:2.0:1788725848.190989:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447680 00000100:00100000:2.0:1788725848.191020:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788725848.191027:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791447680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725848.191037:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725848.191066:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791447680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725848.191071:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788725848.191177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833da680 x1875614791447680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725848.191190:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791447680:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788725848.191976:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725848.192047:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791447936:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725848.192161:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447936 00000100:00100000:1.0:1788725848.192166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447936 00000100:00100000:1.0:1788725848.192201:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725848.192208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791447936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192245:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791447936:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725848.192252:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725848.192282:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791447936:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192315:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791448064:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725848.192369:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448064 00000100:00100000:1.0:1788725848.192373:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448064 00000100:00100000:1.0:1788725848.192396:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725848.192403:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791448064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192437:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791448064:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725848.192444:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725848.192468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791448064:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192507:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791448448:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.192529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725848.192554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448448 00000100:00100000:1.0:1788725848.192557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448448 00000100:00100000:1.0:1788725848.192587:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788725848.192593:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791448448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.192738:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791448192:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.193736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791448448:12345-0@lo:400:kworker.0 Request processed in 1139us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725848.193747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788725848.193777:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725848.193812:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791448448:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.193863:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791448576:0@lo:400:kworker.0 00000100:00100000:2.0:1788725848.194039:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791447808:0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.196572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725848.196871:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791448704:0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.197266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725848.197306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725848.197313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725848.197317:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791448832:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.197349:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791449088:0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.197351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725848.197385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725848.197412:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725848.197419:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791448960:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.197438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725848.197456:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448192 00000100:00100000:3.0:1788725848.197464:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448192 00000100:00100000:3.0:1788725848.197497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448576 00000100:00100000:3.0:1788725848.197500:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448576 00000100:00100000:3.0:1788725848.197523:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449088 00000100:00100000:3.0:1788725848.197526:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449088 00000100:00100000:3.0:1788725848.197555:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448960 00000100:00100000:3.0:1788725848.197558:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448960 00000100:00100000:3.0:1788725848.197579:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788725848.197589:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791448192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725848.198003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725848.198042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791448320:0@lo:400:kworker.0 00000100:00100000:2.0:1788725848.198067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725848.198151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448320 00000100:00100000:2.0:1788725848.198155:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448320 00000100:00100000:2.0:1788725848.198224:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788725848.198232:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791448320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725848.198274:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791448320:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725848.198280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788725848.198321:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791448320:0@lo:400:kworker.0 00000100:00100000:0.0:1788725848.198360:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791447808 00000100:00100000:0.0:1788725848.198364:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791447808 00000100:00100000:0.0:1788725848.198397:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788725848.198407:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791447808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725848.198441:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791447808:12345-0@lo:400:kworker.0 Request processed in 39us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725848.198447:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788725848.198508:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791447808:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.198586:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788725848.198596:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791448576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.198604:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791448192:12345-0@lo:400:kworker.0 Request processed in 1014us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725848.198717:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791448192:0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.198778:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791448576:12345-0@lo:400:kworker.0 Request processed in 183us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725848.198785:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788725848.198802:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788725848.198811:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788725848.198812:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791449088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.198835:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788725848.198847:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725848.198852:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791449088:12345-0@lo:400:kworker.0 Request processed in 40us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725848.198861:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1788725848.198890:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725848.198891:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791448960:12345-0@lo:400:kworker.0 Request processed in 47us (1450us total) trans 0 rc 0/0 00000100:00080000:1.0:1788725848.198896:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725848.199048:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788725848.199075:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448704 00000100:00100000:3.0:1788725848.199080:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448704 00000100:00080000:2.0:1788725848.199156:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725848.199157:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791448832 00000100:00100000:3.0:1788725848.199162:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791448832 00000100:00100000:3.0:1788725848.199201:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788725848.199209:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791448704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725848.199221:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788725848.199231:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791448832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725848.199268:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791448704:12345-0@lo:400:kworker.0 Request processed in 58us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725848.199279:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791448832:12345-0@lo:400:kworker.0 Request processed in 49us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725848.199280:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725848.199291:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788725848.199313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725848.199336:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7adf80 x1875614791448832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725848.199347:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791448832:0@lo:400:kworker.0 00010000:00080000:2.0:1788725848.199358:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387636680 x1875614791448704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725848.199367:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791448704:0@lo:400:kworker.0 00010000:00080000:0.0:1788725848.201449:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af860e00 x1875614791448576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725848.201467:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791448576:0@lo:400:kworker.0 00000100:00100000:0.0:1788725848.201496:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791448960:0@lo:400:kworker.0 00010000:00080000:0.0:1788725848.201508:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7af800 x1875614791449088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725848.201517:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791449088:0@lo:400:kworker.0 00010000:00010000:2.0:1788725848.956256:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725849.211420:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725849.211445:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791449216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725849.211527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725849.211688:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449216 00000100:00100000:1.0:1788725849.211706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449216 00000100:00100000:1.0:1788725849.211754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788725849.211763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791449216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725849.211795:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725849.211850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791449216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725849.211857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788725849.211978:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791449216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725849.979343:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725850.753304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725850.759265:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725850.759343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725850.759466:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449344 00000100:00100000:1.0:1788725850.759475:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449344 00000100:00100000:1.0:1788725850.759530:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788725850.759541:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791449344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725850.759587:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725850.759643:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791449344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725850.759650:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788725850.759808:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791449344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725851.006386:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725851.260144:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725851.260171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791449472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725851.260322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725851.260375:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449472 00000100:00100000:1.0:1788725851.260384:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449472 00000100:00100000:1.0:1788725851.260449:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788725851.260460:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791449472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725851.260491:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725851.260547:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791449472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725851.260554:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788725851.260587:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725851.262700:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791449600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725851.262773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725851.262856:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449600 00010000:00080000:0.0:1788725851.262863:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387636680 x1875614791449472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725851.262871:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449600 00000100:00100000:0.0:1788725851.262906:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791449472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725851.263007:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788725851.263020:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791449600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725851.263047:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725851.263182:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791449600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725851.263190:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788725851.263260:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af866680 x1875614791449600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725851.263277:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791449600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788725851.263407:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725851.841688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725851.841740:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725851.841770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725851.841806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407296 00000100:00100000:0.0:1788725851.841818:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407296 00000100:00100000:0.0:1788725851.842537:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1788725851.842550:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770407296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725851.842825:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2397:x1875614770407296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 275us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725851.842833:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 285 00000100:00100000:0.0:1788725851.846562:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407552 00000100:00100000:0.0:1788725851.846583:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407552 00000100:00100000:0.0:1788725851.846744:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407424 00000100:00100000:0.0:1788725851.846748:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407424 00000100:00100000:0.0:1788725851.846785:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788725851.846798:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770407552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725851.848036:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770407552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1230us (6285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725851.848059:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788725851.848106:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788725851.848129:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770407424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725851.848171:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770407424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725851.848177:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00080000:2.0:1788725851.848586:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725851.848593:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788725852.033956:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725853.053105:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725853.307552:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791449984:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307730:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791450496:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791451008:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307826:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307854:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788725853.307859:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791450112:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307903:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791450624:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307943:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791451136:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.307961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725853.307995:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449984 00000100:00100000:2.0:1788725853.308004:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449984 00000100:00100000:2.0:1788725853.308060:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725853.308081:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791449984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.308453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791449984:12345-0@lo:400:kworker.0 Request processed in 372us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725853.308473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725853.308504:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450496 00000100:00100000:2.0:1788725853.308508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450496 00000100:00100000:2.0:1788725853.308547:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451008 00000100:00100000:2.0:1788725853.308550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451008 00000100:00100000:2.0:1788725853.308565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450112 00000100:00100000:2.0:1788725853.308567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450112 00000100:00100000:2.0:1788725853.308579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788725853.308586:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791450496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.308622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791450496:12345-0@lo:400:kworker.0 Request processed in 36us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725853.308628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788725853.308641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788725853.308657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791451008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.308686:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791451008:12345-0@lo:400:kworker.0 Request processed in 29us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725853.308691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788725853.308802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788725853.308810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791450112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.308839:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791450112:12345-0@lo:400:kworker.0 Request processed in 31us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725853.308845:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788725853.308867:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725853.308906:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791450112:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.308919:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791449984:0@lo:400:kworker.0 00010000:00080000:2.0:1788725853.308931:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823db100 x1875614791450496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725853.308941:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791450496:0@lo:400:kworker.0 00010000:00080000:2.0:1788725853.308950:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be825180 x1875614791451008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725853.308958:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791451008:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309162:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791449728:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309212:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309249:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791450240:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309290:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791450752:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309330:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791451264:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309370:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788725853.309376:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791449856:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309416:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791450368:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309486:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791450880:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309510:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.309539:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449856 00000100:00100000:0.0:1788725853.309544:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449856 00000100:00100000:0.0:1788725853.309577:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450368 00000100:00100000:0.0:1788725853.309580:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450368 00000100:00100000:0.0:1788725853.309601:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450880 00000100:00100000:0.0:1788725853.309604:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450880 00000100:00100000:0.0:1788725853.309619:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788725853.309626:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791449856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309664:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791449856:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.309671:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788725853.309685:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788725853.309691:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791450368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309732:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791450368:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.309738:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788725853.309749:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788725853.309754:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791450880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309779:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791450880:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.309784:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788725853.309807:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450624 00000100:00100000:0.0:1788725853.309810:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450624 00000100:00100000:0.0:1788725853.309829:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451136 00000100:00100000:0.0:1788725853.309832:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451136 00000100:00100000:0.0:1788725853.309843:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450752 00000100:00100000:0.0:1788725853.309844:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450752 00000100:00100000:0.0:1788725853.309854:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451264 00000100:00100000:0.0:1788725853.309856:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451264 00000100:00100000:0.0:1788725853.309868:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725853.309874:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791450624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309926:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791450624:12345-0@lo:400:kworker.0 Request processed in 51us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.309933:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725853.309945:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725853.309951:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791451136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.309979:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791451136:12345-0@lo:400:kworker.0 Request processed in 29us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.309985:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788725853.309997:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725853.310003:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791450752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.310030:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791450752:12345-0@lo:400:kworker.0 Request processed in 28us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.310035:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788725853.310044:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788725853.310050:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791451264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.310085:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791451264:12345-0@lo:400:kworker.0 Request processed in 36us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.310091:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788725853.310110:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725853.310113:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725853.310149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725853.310180:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791449856:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.310192:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791450368:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.310200:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791450880:0@lo:400:kworker.0 00010000:00080000:0.0:1788725853.310224:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842ad180 x1875614791450752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725853.310234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791450752:0@lo:400:kworker.0 00010000:00080000:0.0:1788725853.310244:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be824700 x1875614791451264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725853.310253:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791451264:0@lo:400:kworker.0 00010000:00080000:0.0:1788725853.310288:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842ac700 x1875614791450624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725853.310296:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791450624:0@lo:400:kworker.0 00010000:00080000:0.0:1788725853.310305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be827800 x1875614791451136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725853.310311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791451136:0@lo:400:kworker.0 00000100:00100000:3.0:1788725853.310868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791450240 00000100:00100000:3.0:1788725853.310876:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791450240 00000100:00100000:3.0:1788725853.310915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788725853.310923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791450240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725853.310977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791450240:12345-0@lo:400:kworker.0 Request processed in 55us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725853.310984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788725853.311049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791451392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725853.311094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725853.311151:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451392 00000100:00100000:3.0:1788725853.311156:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451392 00000100:00100000:3.0:1788725853.311184:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788725853.311191:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791451392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725853.311566:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725853.311614:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791451392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 423us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725853.311621:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788725853.311661:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af867b80 x1875614791451392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725853.311679:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791451392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725853.311822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791449728 00000100:00100000:2.0:1788725853.311828:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791449728 00000100:00100000:2.0:1788725853.311867:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788725853.311875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791449728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.311929:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791449728:12345-0@lo:400:kworker.0 Request processed in 54us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725853.311945:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788725853.312028:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791449728:0@lo:400:kworker.0 00000100:00100000:2.0:1788725853.312044:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791450240:0@lo:400:kworker.0 00000100:00100000:0.0:1788725853.312656:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725853.312671:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791451520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725853.312787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725853.312831:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451520 00000100:00100000:0.0:1788725853.312836:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451520 00000100:00100000:0.0:1788725853.312871:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788725853.312880:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791451520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725853.312898:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725853.312937:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791451520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725853.312944:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788725853.312991:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4e00 x1875614791451520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725853.313007:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791451520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788725854.083513:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725854.331359:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725854.331393:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791451648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725854.331498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725854.331665:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451648 00000100:00100000:3.0:1788725854.331676:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451648 00000100:00100000:3.0:1788725854.331741:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788725854.331753:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791451648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725854.331809:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725854.331888:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791451648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725854.331896:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788725854.331952:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791451648:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788725855.099728:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725855.868149:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791451776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725855.868224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725855.868347:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451776 00000100:00100000:2.0:1788725855.868355:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451776 00000100:00100000:2.0:1788725855.868402:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725855.868412:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791451776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725855.868444:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725855.868497:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791451776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725855.868509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788725855.868684:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791451776:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725856.123296:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725856.380498:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791451904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725856.380568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725856.380633:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791451904 00000100:00100000:3.0:1788725856.380640:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791451904 00000100:00100000:3.0:1788725856.380690:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788725856.380701:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791451904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725856.380738:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725856.380784:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791451904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725856.380791:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788725856.380813:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725856.380846:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af867b80 x1875614791451904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725856.380865:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791451904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725856.382160:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791452032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725856.382208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725856.386077:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452032 00000100:00100000:2.0:1788725856.386090:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452032 00000100:00100000:2.0:1788725856.386172:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788725856.386182:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791452032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725856.386206:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788725856.386339:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725856.391384:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791452032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5180us (9152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725856.391399:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788725856.395468:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af867b80 x1875614791452032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725856.395496:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791452032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725856.960914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725856.960955:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725856.960984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725856.961012:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407936 00000100:00100000:0.0:1788725856.961022:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407936 00000100:00100000:0.0:1788725856.961096:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407808 00000100:00100000:0.0:1788725856.961105:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407808 00000100:00100000:0.0:1788725856.961161:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1788725856.961174:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770407936:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725856.961247:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770407936:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725856.961255:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:0.0:1788725856.961273:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788725856.961280:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770407808:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725856.961312:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770407808:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725856.961318:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00080000:0.0:1788725856.961338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725856.961341:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725856.963155:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770407680 00000100:00100000:3.0:1788725856.963177:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770407680 00000100:00100000:3.0:1788725856.963239:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 287 00000100:00100000:3.0:1788725856.963253:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770407680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725856.963329:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770407680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725856.963337:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 287 00010000:00010000:1.0:1788725857.147483:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725858.173168:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725858.427462:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791452160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725858.427527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.427825:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791452416:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.427857:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.427884:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791452928:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.427925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.427940:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791453440:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.427959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.427975:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788725858.427980:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791452288:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.428004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.428022:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791452800:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.428073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.428092:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791453312:0@lo:400:kworker.0 00000100:00100000:0.0:1788725858.428113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725858.428160:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452416 00000100:00100000:0.0:1788725858.428168:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452416 00000100:00100000:0.0:1788725858.428208:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452928 00000100:00100000:0.0:1788725858.428210:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452928 00000100:00100000:0.0:1788725858.428229:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453440 00000100:00100000:0.0:1788725858.428232:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453440 00000100:00100000:0.0:1788725858.428249:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788725858.428256:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791452416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452288 00000100:00100000:2.0:1788725858.428356:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452288 00000100:00100000:2.0:1788725858.428384:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788725858.428391:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791452288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428435:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791452288:12345-0@lo:400:kworker.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428442:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788725858.428478:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791452544:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428522:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791453056:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428553:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428582:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788725858.428588:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791452672:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428615:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791453184:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428647:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791453696:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.428684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452800 00000100:00100000:2.0:1788725858.428687:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452800 00000100:00100000:2.0:1788725858.428707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452544 00000100:00100000:2.0:1788725858.428709:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452544 00000100:00100000:2.0:1788725858.428720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725858.428725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791452800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791452800:12345-0@lo:400:kworker.0 Request processed in 28us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428759:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725858.428776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788725858.428781:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791452544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428812:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791452544:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428817:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788725858.428832:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453312 00000100:00100000:2.0:1788725858.428835:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453312 00000100:00100000:2.0:1788725858.428856:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453184 00000100:00100000:2.0:1788725858.428859:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453184 00000100:00100000:2.0:1788725858.428869:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453696 00000100:00100000:2.0:1788725858.428871:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453696 00000100:00100000:2.0:1788725858.428881:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788725858.428886:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791453312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428912:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791453312:12345-0@lo:400:kworker.0 Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428918:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788725858.428927:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788725858.428932:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428951:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791453184:12345-0@lo:400:kworker.0 Request processed in 20us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428956:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788725858.428964:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788725858.428968:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791453696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.428988:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791453696:12345-0@lo:400:kworker.0 Request processed in 20us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.428994:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788725858.429046:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4000 x1875614791453184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725858.429066:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791453184:0@lo:400:kworker.0 00010000:00080000:2.0:1788725858.429079:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4380 x1875614791453696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725858.429087:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791453696:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429095:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791452544:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429142:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791452288:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429151:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791452800:0@lo:400:kworker.0 00010000:00080000:2.0:1788725858.429159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f5f80 x1875614791453312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725858.429168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791453312:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429178:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725858.429187:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791453824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725858.429211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725858.429260:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453056 00000100:00100000:2.0:1788725858.429264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453056 00000100:00100000:2.0:1788725858.429283:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453568 00000100:00100000:2.0:1788725858.429285:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453568 00000100:00100000:2.0:1788725858.429295:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452672 00000100:00100000:2.0:1788725858.429297:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452672 00000100:00100000:2.0:1788725858.429307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788725858.429318:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791452928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791452928:12345-0@lo:400:kworker.0 Request processed in 38us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.429369:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788725858.429383:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725858.429389:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791453440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429417:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791453440:12345-0@lo:400:kworker.0 Request processed in 28us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.429422:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725858.429435:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788725858.429440:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791453056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.429469:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791453056:12345-0@lo:400:kworker.0 Request processed in 29us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.429474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788725858.429485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788725858.429641:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791452416:12345-0@lo:400:kworker.0 Request processed in 1384us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725858.429670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791453568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725858.429681:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791452160 00000100:00100000:3.0:1788725858.429685:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791452160 00000100:00100000:2.0:1788725858.429699:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791453568:12345-0@lo:400:kworker.0 Request processed in 32us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725858.429716:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453824 00000100:00100000:3.0:1788725858.429719:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453824 00000100:00100000:3.0:1788725858.429736:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788725858.429743:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791452160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725858.429764:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725858.429813:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791452160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725858.429819:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788725858.429831:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788725858.429838:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791453824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788725858.429847:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725858.429869:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791453824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725858.429874:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788725858.429902:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788725858.429909:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:3.0:1788725858.430000:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b9f80 x1875614791453824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725858.430015:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791453824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725858.430047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788725858.430058:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791452928:0@lo:400:kworker.0 00000100:00100000:3.0:1788725858.430068:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791453440:0@lo:400:kworker.0 00000100:00100000:1.0:1788725858.431302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788725858.431322:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791452672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725858.431399:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791452672:12345-0@lo:400:kworker.0 Request processed in 85us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725858.431407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1788725858.431462:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af867b80 x1875614791452160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725858.431484:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791452160:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788725858.431526:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725858.431542:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725858.431544:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725858.431547:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725858.431756:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788725858.431768:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791452672:0@lo:400:kworker.0 00010000:00080000:1.0:1788725858.431781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f5c00 x1875614791453056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725858.431861:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791453056:0@lo:400:kworker.0 00010000:00080000:1.0:1788725858.431879:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4700 x1875614791453568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725858.431890:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788725858.432047:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:1.0:1788725859.195592:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725859.451915:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725859.451959:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791453952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725859.452153:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725859.452244:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791453952 00000100:00100000:2.0:1788725859.452254:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791453952 00000100:00100000:2.0:1788725859.452309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788725859.452320:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791453952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725859.452354:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725859.452409:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791453952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725859.452415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788725859.452658:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791453952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725860.223418:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725860.507963:0:11988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:17:38 (1788725858) === 00000100:00100000:1.0:1788725860.987909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791454080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725860.987975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725860.988077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454080 00000100:00100000:2.0:1788725860.988097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454080 00000100:00100000:2.0:1788725860.988175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788725860.988187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791454080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725860.988219:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725860.988752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791454080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 566us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725860.988761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788725860.988792:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791454080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725861.005714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.006729:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408064 00000100:00100000:3.0:1788725861.006744:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408064 00000100:00100000:3.0:1788725861.006830:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:3.0:1788725861.006844:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+10:8722:x1875614770408064:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788725861.006876:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725861.006902:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1380030200/0xa13c582691d36f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6cd7 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725861.006938:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1380030200/0xa13c582691d36f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd7 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725861.006951:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1380030200/0xa13c582691d36f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd7 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725861.006963:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380030200, rc 0) 00000100:00100000:3.0:1788725861.007509:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408064:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 656us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.007523:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:0.0:1788725861.016821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.017191:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408192 00000100:00100000:2.0:1788725861.017206:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408192 00000100:00100000:2.0:1788725861.017645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:2.0:1788725861.017660:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408192:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788725861.019206:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408192:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 1537us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.019222:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:0.0:1788725861.026693:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.027061:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408320 00000100:00100000:3.0:1788725861.027071:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408320 00000100:00100000:3.0:1788725861.027351:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:3.0:1788725861.027370:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408320:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788725861.027531:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408320:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 162us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.027539:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:0.0:1788725861.038628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.038787:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408448 00000100:00100000:2.0:1788725861.038797:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408448 00000100:00100000:2.0:1788725861.038853:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:2.0:1788725861.038863:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408448:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725861.039041:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408448:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 178us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.039050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 292 00000100:00100000:2.0:1788725861.074211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.074361:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408576 00000100:00100000:3.0:1788725861.074371:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408576 00000100:00100000:3.0:1788725861.074428:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:3.0:1788725861.074439:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408576:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788725861.074608:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408576:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 170us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.074618:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 293 00000100:00100000:3.0:1788725861.081816:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725861.082340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408704 00000100:00100000:0.0:1788725861.082350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408704 00000100:00100000:0.0:1788725861.082419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:0.0:1788725861.082428:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408704:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788725861.082576:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8726:x1875614770408704:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 148us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.082584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 294 00000100:00100000:0.0:1788725861.087403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.087619:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408832 00000100:00100000:2.0:1788725861.087629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408832 00000100:00100000:2.0:1788725861.087720:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:2.0:1788725861.087730:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:8722:x1875614770408832:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788725861.087758:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725861.087796:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383659400/0xa13c582691d36f27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d08 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725861.087835:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659400/0xa13c582691d36f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d08 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725861.087846:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383659400/0xa13c582691d36f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d08 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725861.087856:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659400, rc 0) 00000100:00100000:2.0:1788725861.087916:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:8722:x1875614770408832:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 187us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.087924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 295 00000100:00100000:2.0:1788725861.090919:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.094322:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770408960 00000100:00100000:3.0:1788725861.094337:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770408960 00000100:00100000:3.0:1788725861.094467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:3.0:1788725861.094479:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:8722:x1875614770408960:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788725861.094505:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788725861.094530:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788725861.094535:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788725861.094539:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788725861.094541:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788725861.094544:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788725861.097652:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:8722:x1875614770408960:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 3163us (6731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725861.097665:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 296 00000100:00100000:2.0:1788725861.100520:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725861.100603:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409088 00000100:00100000:0.0:1788725861.100614:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409088 00000100:00100000:0.0:1788725861.100669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:0.0:1788725861.100679:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:8722:x1875614770409088:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788725861.100696:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725861.100713:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d0f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725861.100741:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725861.100753:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725861.100764:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af400, rc 0) 00000100:00100000:0.0:1788725861.100825:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8722:x1875614770409088:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 147us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.100832:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 297 00000100:00100000:2.0:1788725861.104940:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725861.105283:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409216 00000100:00100000:0.0:1788725861.105293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409216 00000100:00100000:0.0:1788725861.105348:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:0.0:1788725861.105359:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8722:x1875614770409216:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788725861.105519:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8722:x1875614770409216:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 161us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.105527:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:3.0:1788725861.110673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725861.115296:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409344 00000100:00100000:1.0:1788725861.115342:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409344 00000100:00100000:1.0:1788725861.115432:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:1.0:1788725861.115445:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8722:x1875614770409344:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788725861.116105:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8722:x1875614770409344:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 651us (5438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725861.116148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:3.0:1788725861.128820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.133051:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409472 00000100:00100000:2.0:1788725861.133074:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409472 00000100:00100000:2.0:1788725861.133386:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:2.0:1788725861.133400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8730:x1875614770409472:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725861.134317:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8730:x1875614770409472:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 906us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.134342:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:2.0:1788725861.139438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725861.139541:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409600 00000100:00100000:1.0:1788725861.139551:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409600 00000100:00100000:1.0:1788725861.139660:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:1.0:1788725861.139671:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8730:x1875614770409600:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788725861.139982:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:8730:x1875614770409600:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 311us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725861.139990:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:3.0:1788725861.148043:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.148559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.148582:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.148646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.148681:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410496 00000100:00100000:3.0:1788725861.148690:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410496 00000100:00100000:3.0:1788725861.148742:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410368 00000100:00100000:3.0:1788725861.148745:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410368 00000100:00100000:3.0:1788725861.148757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409728 00000100:00100000:3.0:1788725861.148759:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409728 00000100:00100000:3.0:1788725861.148766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409984 00000100:00100000:3.0:1788725861.148768:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409984 00000100:00100000:3.0:1788725861.148779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788725861.148789:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770410496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725861.148883:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770410496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 94us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.148890:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:3.0:1788725861.148905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1788725861.148912:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770410368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725861.148935:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770410368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.148941:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1788725861.148952:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788725861.148956:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875614770409728:12345-192.168.203.12@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788725861.149110:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788725861.149132:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875614770409984:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788725861.149148:0:9522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ed75931d-dab3-4684-a02c-ea7022155724@192.168.203.12@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1788725861.149180:0:9522:0:(genops.c:1385:class_connect()) connect: client ed75931d-dab3-4684-a02c-ea7022155724, cookie 0xa13c582691d36f35 00000004:00100000:0.0:1788725861.149203:0:9522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788725861.149354:0:9522:0:(import.c:65:import_set_state_nolock()) ffff9b12835e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788725861.149384:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+6:2394:x1875614770409984:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 267us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.149390:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00010000:00080000:3.0:1788725861.149658:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ed75931d-dab3-4684-a02c-ea7022155724@192.168.203.12@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788725861.149685:0:6510:0:(genops.c:1385:class_connect()) connect: client ed75931d-dab3-4684-a02c-ea7022155724, cookie 0xa13c582691d36f3c 00000004:00100000:3.0:1788725861.149698:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788725861.151189:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9b139f7b5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725861.151245:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+6:2394:x1875614770409728:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 2285us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.151267:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00080000:1.0:1788725861.153051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725861.153062:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725861.160358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.160396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.160432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725861.160470:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410240 00000100:00100000:1.0:1788725861.160480:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410240 00000100:00100000:0.0:1788725861.160513:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770409856 00000100:00100000:0.0:1788725861.160517:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770409856 00000100:00080000:3.0:1788725861.160604:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725861.160653:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410112 00000100:00100000:0.0:1788725861.160657:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410112 00000100:00080000:3.0:1788725861.160712:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725861.164021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788725861.164050:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+7:0:x1875614770409856:12345-192.168.203.12@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788725861.164127:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788725861.164138:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+7:8722:x1875614770410240:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788725861.164144:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:2.0:1788725861.164165:0:11950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725861.164252:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+7:8722:x1875614770410240:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 117us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.164260:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788725861.164281:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788725861.164289:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+6:0:x1875614770410112:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788725861.164308:0:11950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725861.168538:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+6:0:x1875614770409856:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 4491us (8129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725861.168554:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788725861.170499:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725861.170586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410624 00000100:00100000:0.0:1788725861.170595:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410624 00000100:00100000:0.0:1788725861.170648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788725861.170659:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770410624:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788725861.170744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770410624:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 87us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.170751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788725861.171047:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+6:0:x1875614770410112:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 6756us (10611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.171056:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788725861.175916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725861.176350:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411008 00000100:00100000:0.0:1788725861.176362:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411008 00000100:00100000:0.0:1788725861.176436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788725861.176463:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770411008:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788725861.176557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770411008:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 98us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.176569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788725861.177644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.177722:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410752 00000100:00100000:2.0:1788725861.177729:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410752 00000100:00100000:2.0:1788725861.177764:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788725861.177773:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875614770410752:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788725861.177802:0:8426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ed75931d-dab3-4684-a02c-ea7022155724@192.168.203.12@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1788725861.177833:0:8426:0:(genops.c:1385:class_connect()) connect: client ed75931d-dab3-4684-a02c-ea7022155724, cookie 0xa13c582691d36f43 00002000:00100000:2.0:1788725861.177844:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed75931d-dab3-4684-a02c-ea7022155724/ffff9b139f7cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725861.177859:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725861.177932:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788725861.177966:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b139f7c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725861.178012:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+6:2394:x1875614770410752:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 238us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.178030:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788725861.178761:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725861.178852:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770410880 00000100:00100000:2.0:1788725861.178870:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770410880 00000100:00100000:2.0:1788725861.178939:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:2.0:1788725861.178946:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875614770410880:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788725861.178988:0:8425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ed75931d-dab3-4684-a02c-ea7022155724@192.168.203.12@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:2.0:1788725861.179020:0:8425:0:(genops.c:1385:class_connect()) connect: client ed75931d-dab3-4684-a02c-ea7022155724, cookie 0xa13c582691d36f4a 00002000:00100000:2.0:1788725861.179029:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed75931d-dab3-4684-a02c-ea7022155724/ffff9b139f7cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725861.179041:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725861.179088:0:8425:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725861.179108:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b139f7ce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725861.179184:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed75931d-dab3-4684-a02c-ea7022155724+6:2394:x1875614770410880:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 236us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725861.179190:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788725861.185460:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725861.185600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411136 00000100:00100000:3.0:1788725861.185611:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411136 00000100:00100000:3.0:1788725861.185665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:3.0:1788725861.185676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770411136:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788725861.185760:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788725861.185848:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed75931d-dab3-4684-a02c-ea7022155724+6:8722:x1875614770411136:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 173us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.185855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00010000:00010000:2.0:1788725861.243290:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725861.499651:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791454208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725861.499725:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725861.499740:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791454336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725861.499798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725861.499983:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454336 00000100:00100000:3.0:1788725861.499990:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454336 00000100:00100000:3.0:1788725861.500064:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788725861.500075:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791454336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725861.500096:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725861.500162:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791454336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725861.500169:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788725861.500250:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725861.500278:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4700 x1875614791454336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725861.500297:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791454336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725861.501427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725861.501491:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454208 00000100:00100000:0.0:1788725861.501500:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454208 00000100:00080000:2.0:1788725861.501578:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725861.501702:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788725861.501713:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791454208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788725861.501735:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725861.501794:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791454208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725861.501801:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788725861.501992:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2aa00 x1875614791454208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725861.502021:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791454208:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788725862.274055:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725863.292264:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725863.547973:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791454464:0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.548051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725863.548178:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454464 00000100:00100000:2.0:1788725863.548185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454464 00000100:00100000:2.0:1788725863.548230:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788725863.548239:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791454464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.548539:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791454464:12345-0@lo:400:kworker.0 Request processed in 289us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725863.548555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788725863.548590:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791454592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725863.548621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725863.548653:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725863.548659:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791454720:0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.548706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725863.548744:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454720 00000100:00100000:2.0:1788725863.548748:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454720 00000100:00100000:2.0:1788725863.548779:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788725863.548786:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791454720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.548819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791454720:12345-0@lo:400:kworker.0 Request processed in 33us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725863.548824:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788725863.548860:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791454720:0@lo:400:kworker.0 00000100:00100000:0.0:1788725863.548917:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454592 00000100:00100000:0.0:1788725863.548921:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454592 00000100:00100000:0.0:1788725863.548964:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788725863.548972:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791454592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725863.548993:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725863.549050:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791454592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725863.549057:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788725863.549267:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791454848:0@lo:400:kworker.0 00000100:00100000:0.0:1788725863.549296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725863.549352:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725863.549358:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791454976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725863.549381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788725863.549550:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725863.549563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454848 00000100:00100000:2.0:1788725863.549568:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454848 00000100:00100000:2.0:1788725863.549596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788725863.549603:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791454848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.549643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791454848:12345-0@lo:400:kworker.0 Request processed in 41us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725863.549650:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788725863.549689:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791454848:0@lo:400:kworker.0 00010000:00080000:2.0:1788725863.549713:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f4700 x1875614791454592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725863.549744:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791454592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725863.549929:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791454464:0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.550099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791455104:0@lo:400:kworker.0 00000100:00100000:2.0:1788725863.550205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725863.550336:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791455232:0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.550364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725863.550415:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455104 00000100:00100000:0.0:1788725863.550427:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455104 00000100:00100000:0.0:1788725863.550464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788725863.550472:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.550847:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791454976 00000100:00100000:3.0:1788725863.550857:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791454976 00000100:00100000:3.0:1788725863.550895:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788725863.550903:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791454976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788725863.550918:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725863.550953:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791454976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725863.550959:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788725863.550977:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455232 00000100:00100000:3.0:1788725863.550980:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455232 00000100:00100000:3.0:1788725863.551011:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788725863.551017:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791455232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551046:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791455232:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725863.551051:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788725863.551067:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791455744:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551089:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725863.551141:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791455232:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551152:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725863.551157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791455616:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725863.551196:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791455488:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725863.551227:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791456000:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725863.551255:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788725863.551259:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791455360:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725863.551295:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791455872:0@lo:400:kworker.0 00000100:00100000:3.0:1788725863.551309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725863.551626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455488 00000100:00100000:1.0:1788725863.551631:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455488 00000100:00100000:1.0:1788725863.551651:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456000 00000100:00100000:1.0:1788725863.551653:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456000 00000100:00100000:1.0:1788725863.551663:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455360 00000100:00100000:1.0:1788725863.551665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455360 00000100:00100000:1.0:1788725863.551674:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455872 00000100:00100000:1.0:1788725863.551675:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455872 00000100:00100000:1.0:1788725863.551687:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725863.551693:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791455488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.551733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791455488:12345-0@lo:400:kworker.0 Request processed in 40us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725863.551740:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725863.551752:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788725863.551758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791456000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.551794:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791456000:12345-0@lo:400:kworker.0 Request processed in 37us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725863.551800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788725863.551811:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788725863.551816:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791455360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.551836:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791455360:12345-0@lo:400:kworker.0 Request processed in 20us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725863.551841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788725863.551849:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788725863.551854:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791455872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.551872:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791455872:12345-0@lo:400:kworker.0 Request processed in 18us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725863.551876:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788725863.551899:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791455360:0@lo:400:kworker.0 00000100:00100000:1.0:1788725863.551907:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791455872:0@lo:400:kworker.0 00010000:00080000:1.0:1788725863.551917:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367ea00 x1875614791455488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725863.551927:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791455488:0@lo:400:kworker.0 00010000:00080000:1.0:1788725863.551934:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367d180 x1875614791456000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725863.551942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791456000:0@lo:400:kworker.0 00010000:00080000:1.0:1788725863.551969:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be828000 x1875614791454976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725863.551993:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791454976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725863.554264:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791455104:12345-0@lo:400:kworker.0 Request processed in 3784us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725863.554278:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788725863.554316:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455744 00000100:00100000:0.0:1788725863.554324:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455744 00000100:00100000:0.0:1788725863.554362:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791455616 00000100:00100000:0.0:1788725863.554365:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791455616 00000100:00100000:0.0:1788725863.554388:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788725863.554397:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791455744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725863.554466:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791455744:12345-0@lo:400:kworker.0 Request processed in 70us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725863.554472:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788725863.554485:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788725863.554491:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791455616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725863.554518:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791455616:12345-0@lo:400:kworker.0 Request processed in 28us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725863.554524:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788725863.554671:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367f800 x1875614791455616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725863.554685:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791455616:0@lo:400:kworker.0 00010000:00080000:0.0:1788725863.554697:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367ce00 x1875614791455744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725863.554705:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791455744:0@lo:400:kworker.0 00000100:00080000:0.0:1788725863.555215:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725863.555220:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725863.555223:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725863.555226:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725863.557269:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791455104:0@lo:400:kworker.0 00010000:00010000:2.0:1788725864.315765:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725864.576697:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791456128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725864.576765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725864.577423:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456128 00000100:00100000:0.0:1788725864.577434:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456128 00000100:00100000:0.0:1788725864.577496:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788725864.577506:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791456128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725864.577550:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725864.580405:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791456128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2891us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725864.580419:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788725864.591727:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791456128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725865.346081:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725866.022664:0:12180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788725866.108282:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725866.108308:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791456256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725866.108388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725866.108721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456256 00000100:00100000:1.0:1788725866.108731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456256 00000100:00100000:1.0:1788725866.108785:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788725866.108796:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13a96e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791456256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725866.108835:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725866.108904:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13a96e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791456256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725866.108911:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788725866.109544:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791456256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725866.363337:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725866.619393:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725866.619425:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791456384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725866.619536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725866.621265:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791456512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725866.621332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725866.621393:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456384 00000100:00100000:1.0:1788725866.621401:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456384 00000100:00100000:1.0:1788725866.621452:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456512 00000100:00100000:1.0:1788725866.621455:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456512 00000100:00100000:1.0:1788725866.621473:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788725866.621481:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791456384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725866.621510:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725866.621555:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791456384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725866.621562:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788725866.621578:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788725866.621585:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791456512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725866.621604:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725866.621630:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791456512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725866.621636:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788725866.621670:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128346f800 x1875614791456512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725866.621687:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791456512:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788725866.621722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367ed80 x1875614791456384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725866.621735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791456384:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788725866.621960:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788725866.623595:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000001:00100000:3.0:1788725866.623690:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000001:00100000:3.0:1788725866.623845:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000001:00100000:2.0:1788725866.627571:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000100:00100000:0.0:1788725866.685360:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725866.686030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725866.688917:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725866.688949:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725866.688970:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725866.689054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411264 00000100:00100000:2.0:1788725866.689063:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411264 00000100:00100000:2.0:1788725866.689111:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 303 00000100:00100000:2.0:1788725866.689152:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770411264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725866.689219:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770411264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725866.689227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 303 00000100:00100000:2.0:1788725866.689260:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411904 00000100:00100000:2.0:1788725866.689264:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411904 00000100:00100000:2.0:1788725866.689311:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788725866.689319:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725866.689347:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725866.689367:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788725866.690031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411392 00000100:00100000:1.0:1788725866.690039:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411392 00000100:00100000:1.0:1788725866.690076:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411648 00000100:00100000:1.0:1788725866.690080:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411648 00000100:00100000:1.0:1788725866.690105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1788725866.690113:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770411392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725866.690162:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770411392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 50us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725866.690169:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1788725866.690188:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:1.0:1788725866.690195:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725866.690220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725866.690238:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788725866.691992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725866.692029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:0.0:1788725866.692049:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725866.692053:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725866.692068:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412032 00000100:00100000:0.0:1788725866.692075:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412032 00000100:00100000:0.0:1788725866.692147:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788725866.692157:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770412032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725866.692209:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770412032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725866.692226:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788725866.692249:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411520 00000100:00100000:0.0:1788725866.692254:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411520 00000100:00100000:0.0:1788725866.692276:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770411776 00000100:00100000:0.0:1788725866.692279:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770411776 00000100:00100000:2.0:1788725866.692391:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788725866.692436:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788725866.693362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770411520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725866.693413:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770411520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1014us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725866.693421:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788725866.693512:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725866.693541:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770411776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1099us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725866.693548:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00080000:0.0:1788725866.693571:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725866.693576:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788725867.387650:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725868.412017:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725868.668532:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791456640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725868.668587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.669020:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791456896:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.669054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.669083:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791457408:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.669104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.669140:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791457920:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.669161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.669184:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788725868.669190:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791457024:0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.670137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456896 00000100:00100000:0.0:1788725868.670148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456896 00000100:00100000:0.0:1788725868.670196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457408 00000100:00100000:0.0:1788725868.670198:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457408 00000100:00100000:0.0:1788725868.670222:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457920 00000100:00100000:0.0:1788725868.670224:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457920 00000100:00100000:0.0:1788725868.670240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788725868.670248:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791456896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.670308:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791456896:12345-0@lo:400:kworker.0 Request processed in 61us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.670315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788725868.670332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788725868.670338:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791457408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.670365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791457408:12345-0@lo:400:kworker.0 Request processed in 27us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.670384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788725868.670396:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788725868.670401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.670429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791457920:12345-0@lo:400:kworker.0 Request processed in 28us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.670434:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788725868.670457:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725868.671317:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791456768:0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.671367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725868.671407:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791457280:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.671694:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791457536:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.671737:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791458048:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671757:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725868.671792:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791456896:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671805:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791457408:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671815:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791457920:0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.671872:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457536 00000100:00100000:2.0:1788725868.671877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457536 00000100:00100000:2.0:1788725868.671917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458048 00000100:00100000:2.0:1788725868.671920:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458048 00000100:00100000:2.0:1788725868.671939:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788725868.671947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791457536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.672001:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791457536:12345-0@lo:400:kworker.0 Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725868.672007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788725868.672025:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788725868.672032:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791458048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725868.672057:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791458048:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725868.672062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:2.0:1788725868.672088:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be829500 x1875614791457536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725868.672098:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791457536:0@lo:400:kworker.0 00010000:00080000:2.0:1788725868.672107:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767ce00 x1875614791458048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725868.672113:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791458048:0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791457152:0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725868.672272:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791457664:0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725868.672314:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725868.672366:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457664 00000100:00100000:3.0:1788725868.672370:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457664 00000100:00100000:3.0:1788725868.672396:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458176 00000100:00100000:3.0:1788725868.672398:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458176 00000100:00100000:3.0:1788725868.672416:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788725868.672432:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791457664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672467:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791457664:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725868.672473:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788725868.672485:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788725868.672491:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725868.672531:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791458176:12345-0@lo:400:kworker.0 Request processed in 40us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725868.672535:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788725868.672568:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be829c00 x1875614791457664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725868.672576:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791457664:0@lo:400:kworker.0 00010000:00080000:3.0:1788725868.672583:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767fb80 x1875614791458176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725868.672590:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791458176:0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.672726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725868.672760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791457792:0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.672784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725868.672815:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456640 00000100:00100000:1.0:1788725868.672820:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456640 00000100:00100000:1.0:1788725868.672850:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788725868.672857:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791456640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725868.672878:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725868.672910:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791456640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725868.672916:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788725868.672940:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791456768 00000100:00100000:1.0:1788725868.672944:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791456768 00000100:00100000:1.0:1788725868.672979:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788725868.672986:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791456768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.673019:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791456768:12345-0@lo:400:kworker.0 Request processed in 34us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725868.673025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788725868.673053:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457792 00000100:00100000:1.0:1788725868.673057:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457792 00000100:00100000:1.0:1788725868.673088:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788725868.673094:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791457792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.673142:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791457792:12345-0@lo:400:kworker.0 Request processed in 47us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725868.673148:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788725868.673173:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791456768:0@lo:400:kworker.0 00010000:00080000:1.0:1788725868.673182:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be828000 x1875614791457792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725868.673191:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791457792:0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.673317:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457024 00000100:00100000:0.0:1788725868.673321:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457024 00000100:00100000:0.0:1788725868.673344:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457280 00000100:00100000:0.0:1788725868.673347:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457280 00000100:00100000:0.0:1788725868.673360:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788725868.673366:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791457024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.673410:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791457024:12345-0@lo:400:kworker.0 Request processed in 43us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.673416:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788725868.673429:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788725868.673435:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791457280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.673460:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791457280:12345-0@lo:400:kworker.0 Request processed in 25us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.673465:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788725868.673483:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791457152 00000100:00100000:0.0:1788725868.673486:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791457152 00000100:00100000:0.0:1788725868.673508:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788725868.673514:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791457152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.673541:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791457152:12345-0@lo:400:kworker.0 Request processed in 27us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.673553:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788725868.673576:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725868.673581:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725868.673583:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725868.673603:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791457024:0@lo:400:kworker.0 00000100:00100000:1.0:1788725868.673664:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791458304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725868.673691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725868.673722:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791457280:0@lo:400:kworker.0 00000100:00100000:0.0:1788725868.673782:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458304 00000100:00100000:0.0:1788725868.673786:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458304 00000100:00100000:0.0:1788725868.673815:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788725868.673822:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791458304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725868.673832:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725868.673860:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791458304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725868.673866:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788725868.674073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791457152:0@lo:400:kworker.0 00010000:00080000:3.0:1788725868.674086:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f7b80 x1875614791456640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725868.674101:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791456640:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788725868.674465:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767f100 x1875614791458304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725868.674478:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791458304:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788725869.435374:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725869.692391:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791458432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725869.692457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725869.692621:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458432 00000100:00100000:3.0:1788725869.692630:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458432 00000100:00100000:3.0:1788725869.692677:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788725869.692686:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791458432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725869.692727:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725869.692776:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791458432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725869.692782:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788725869.692831:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791458432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788725870.459457:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725871.229054:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791458560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725871.229213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725871.229402:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458560 00000100:00100000:3.0:1788725871.229412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458560 00000100:00100000:3.0:1788725871.229508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788725871.229518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791458560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788725871.229552:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788725871.229768:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791458560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 250us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725871.229776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788725871.229836:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791458560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725871.483724:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725871.740080:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791458688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725871.740180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725871.740249:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725871.740255:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791458816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725871.740276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725871.740400:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458688 00000100:00100000:2.0:1788725871.740422:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458688 00000100:00100000:2.0:1788725871.740486:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458816 00000100:00100000:2.0:1788725871.740489:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458816 00000100:00100000:2.0:1788725871.740508:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788725871.740516:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791458688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725871.740542:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725871.740586:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791458688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.740593:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788725871.740608:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788725871.740615:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791458816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725871.740625:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725871.740646:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791458816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.740652:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788725871.741664:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725871.741711:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f6d80 x1875614791458816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725871.741745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791458816:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788725871.741760:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367f800 x1875614791458688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725871.741772:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791458688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725871.811292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.811359:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.812662:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.812693:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.812712:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725871.816633:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412288 00000100:00100000:0.0:1788725871.816648:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412288 00000100:00100000:0.0:1788725871.816762:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412544 00000100:00100000:0.0:1788725871.816766:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412544 00000100:00100000:0.0:1788725871.816996:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1788725871.817011:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770412288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725871.817096:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770412288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 89us (5812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725871.817103:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1788725871.817144:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:0.0:1788725871.817160:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412544:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725871.817189:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412544:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725871.817195:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00080000:0.0:1788725871.817340:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725871.819838:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.823870:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725871.823909:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412800 00000100:00100000:2.0:1788725871.823918:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412800 00000100:00100000:2.0:1788725871.823982:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412928 00000100:00100000:2.0:1788725871.823985:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412928 00000100:00100000:2.0:1788725871.824011:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788725871.824021:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725871.824101:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (11443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.824108:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788725871.824143:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788725871.824151:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725871.824176:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.824181:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788725871.824199:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412160 00000100:00100000:2.0:1788725871.824202:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412160 00000100:00100000:2.0:1788725871.824227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00100000:2.0:1788725871.824233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770412160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725871.824255:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770412160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (11562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.824261:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 305 00000100:00080000:2.0:1788725871.824286:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725871.824290:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725871.826672:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412416 00000100:00100000:1.0:1788725871.826687:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412416 00000100:00100000:1.0:1788725871.826762:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770412672 00000100:00100000:1.0:1788725871.826766:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770412672 00000100:00100000:1.0:1788725871.826808:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:1.0:1788725871.826818:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770412416:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:2.0:1788725871.827005:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725871.827160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1788725871.827170:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412672:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725871.827206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770412672:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 37us (7378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725871.827213:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:1.0:1788725871.829998:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770412416:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 77us (14180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725871.830027:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000020:00000004:3.0:1788725872.338052:0:12496:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788725872.338501:0:12496:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788725872.507403:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725873.531892:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725873.787975:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791458944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725873.788063:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725873.788114:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791459072:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.788153:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791459456:0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.788170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.788190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725873.788207:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791459584:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.788220:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791459968:0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.788240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.788256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725873.788265:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791460096:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.788285:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791460480:0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.788292:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.788320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725873.788332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459584 00000100:00100000:0.0:1788725873.788341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459584 00000100:00100000:1.0:1788725873.788363:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791459200:0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.788390:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788725873.788402:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791459584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.788412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.788434:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791459712:0@lo:400:kworker.0 00000100:00100000:3.0:1788725873.788534:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725873.788543:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791460608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725873.788633:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791459584:12345-0@lo:400:kworker.0 Request processed in 232us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725873.788641:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788725873.788665:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459968 00000100:00100000:0.0:1788725873.788669:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459968 00000100:00100000:0.0:1788725873.788701:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460096 00000100:00100000:0.0:1788725873.788704:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460096 00000100:00100000:0.0:1788725873.788716:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460480 00000100:00100000:0.0:1788725873.788719:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460480 00000100:00100000:0.0:1788725873.788732:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788725873.788739:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791459968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.793956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.794020:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791460224:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.794111:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788725873.794135:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791459328:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.794191:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791459840:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.794233:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791460352:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.794295:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791458944 00000100:00100000:1.0:1788725873.794304:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791458944 00000100:00100000:1.0:1788725873.794362:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725873.794373:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791458944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725873.794402:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725873.794442:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e9a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791458944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.794450:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788725873.794624:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459072 00000100:00100000:1.0:1788725873.794629:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459072 00000100:00100000:1.0:1788725873.794658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788725873.794665:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791459072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794698:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791459072:12345-0@lo:400:kworker.0 Request processed in 34us (6529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.794718:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788725873.794746:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459456 00000100:00100000:1.0:1788725873.794750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459456 00000100:00100000:1.0:1788725873.794769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459200 00000100:00100000:1.0:1788725873.794772:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459200 00000100:00100000:1.0:1788725873.794783:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459712 00000100:00100000:1.0:1788725873.794785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459712 00000100:00100000:1.0:1788725873.794798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460224 00000100:00100000:1.0:1788725873.794801:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460224 00000100:00100000:1.0:1788725873.794814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459840 00000100:00100000:1.0:1788725873.794816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459840 00000100:00100000:1.0:1788725873.794826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460352 00000100:00100000:1.0:1788725873.794828:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460352 00000100:00100000:1.0:1788725873.794843:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788725873.794850:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791459456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.794883:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791459456:12345-0@lo:400:kworker.0 Request processed in 34us (6694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.794889:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788725873.794901:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788725873.794907:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791459200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725873.795008:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791459328 00000100:00100000:3.0:1788725873.795013:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791459328 00000100:00100000:0.0:1788725873.796037:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791459968:12345-0@lo:400:kworker.0 Request processed in 7290us (7774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725873.796050:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788725873.796073:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788725873.796101:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791460096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725873.796164:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791460096:12345-0@lo:400:kworker.0 Request processed in 67us (7872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791459200:12345-0@lo:400:kworker.0 Request processed in 1358us (7855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788725873.796293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788725873.796302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791459712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791459712:12345-0@lo:400:kworker.0 Request processed in 36us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788725873.796365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788725873.796373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791460224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725873.796377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788725873.796391:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791459328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791460224:12345-0@lo:400:kworker.0 Request processed in 39us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796420:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788725873.796437:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788725873.796444:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791459328:12345-0@lo:400:kworker.0 Request processed in 55us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791459840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725873.796456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788725873.796484:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791459840:12345-0@lo:400:kworker.0 Request processed in 39us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788725873.796502:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788725873.796509:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791460352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796538:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791460352:12345-0@lo:400:kworker.0 Request processed in 30us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725873.796544:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788725873.796549:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788725873.796559:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791460480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.796601:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791460480:12345-0@lo:400:kworker.0 Request processed in 48us (8281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.796631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791459328:0@lo:400:kworker.0 00010000:00080000:1.0:1788725873.796645:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767ce00 x1875614791459840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.796655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791459840:0@lo:400:kworker.0 00010000:00080000:1.0:1788725873.796666:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823da680 x1875614791460352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.796674:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791460352:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791459200:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796706:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791459712:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796715:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791460224:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796777:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791459072:0@lo:400:kworker.0 00000100:00100000:1.0:1788725873.796788:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791459584:0@lo:400:kworker.0 00010000:00080000:1.0:1788725873.796799:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823db800 x1875614791460096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.796807:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791460096:0@lo:400:kworker.0 00000100:00080000:1.0:1788725873.796834:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725873.796839:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725873.796842:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725873.796845:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725873.796981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725873.797021:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791459456:0@lo:400:kworker.0 00010000:00080000:1.0:1788725873.797032:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12823d8380 x1875614791459968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725873.797038:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788725873.797046:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791459968:0@lo:400:kworker.0 00010000:00080000:1.0:1788725873.797060:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b8380 x1875614791460480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.797070:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791460480:0@lo:400:kworker.0 00000100:00100000:0.0:1788725873.797078:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460608 00000100:00100000:0.0:1788725873.797084:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460608 00010000:00080000:1.0:1788725873.797095:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367d180 x1875614791458944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725873.797111:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791458944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725873.797140:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725873.797153:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791460608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725873.797168:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725873.798096:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791460608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 943us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725873.798107:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788725873.801060:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367ea00 x1875614791460608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725873.801088:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791460608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725873.801213:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000020:00000004:1.0:1788725874.386988:0:12593:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788725874.388871:0:12593:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788725874.555531:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725874.815958:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791460736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725874.816050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725874.816227:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460736 00000100:00100000:2.0:1788725874.816236:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460736 00000100:00100000:2.0:1788725874.816290:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788725874.816300:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791460736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725874.816342:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725874.816965:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791460736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 660us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725874.816977:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788725874.817047:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791460736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725875.580751:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725876.347668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725876.347701:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791460864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725876.347809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725876.348006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460864 00000100:00100000:2.0:1788725876.348017:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460864 00000100:00100000:2.0:1788725876.348087:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788725876.348099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791460864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725876.348242:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725876.348299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791460864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 202us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725876.348307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788725876.348447:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791460864:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788725876.466708:0:12691:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788725876.467013:0:12691:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788725876.603747:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725876.863822:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725876.863846:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791460992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725876.863923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725876.864002:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791460992 00000100:00100000:0.0:1788725876.864010:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791460992 00000100:00100000:0.0:1788725876.864065:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788725876.864077:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791460992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788725876.864137:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725876.864179:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791460992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.864186:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788725876.864205:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725876.864241:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b9180 x1875614791460992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725876.864260:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791460992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725876.864588:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725876.864600:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791461120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725876.864632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725876.864756:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461120 00000100:00100000:2.0:1788725876.864761:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461120 00000100:00100000:2.0:1788725876.864799:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788725876.864823:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791461120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725876.864836:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725876.864867:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791461120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725876.864873:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788725876.864901:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82ad80 x1875614791461120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725876.864926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791461120:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788725876.865317:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725876.926816:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926960:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.926983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725876.927008:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413696 00000100:00100000:0.0:1788725876.927017:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413696 00000100:00100000:0.0:1788725876.927078:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413824 00000100:00100000:0.0:1788725876.927082:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413824 00000100:00100000:0.0:1788725876.927104:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788725876.927142:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927225:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927232:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788725876.927249:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788725876.927255:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927294:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927301:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788725876.927320:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413056 00000100:00100000:0.0:1788725876.927323:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413056 00000100:00100000:0.0:1788725876.927347:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 307 00000100:00100000:0.0:1788725876.927354:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770413056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927376:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770413056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927382:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 307 00000100:00100000:0.0:1788725876.927405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413184 00000100:00100000:0.0:1788725876.927408:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413184 00000100:00100000:0.0:1788725876.927429:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413440 00000100:00100000:0.0:1788725876.927432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413440 00000100:00100000:0.0:1788725876.927448:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413312 00000100:00100000:0.0:1788725876.927450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413312 00000100:00100000:0.0:1788725876.927460:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413568 00000100:00100000:0.0:1788725876.927462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413568 00000100:00100000:0.0:1788725876.927475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788725876.927481:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770413184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927505:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770413184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927512:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:0.0:1788725876.927522:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:0.0:1788725876.927528:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927560:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:0.0:1788725876.927572:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1788725876.927577:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770413312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927600:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770413312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927605:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:0.0:1788725876.927614:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:0.0:1788725876.927619:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725876.927637:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770413568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 18us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725876.927642:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00080000:0.0:1788725876.927787:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725876.927791:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725876.927794:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725876.927796:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788725877.627584:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788725878.438066:0:12788:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788725878.438305:0:12788:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788725878.654037:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725878.907374:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791461632:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907508:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791462144:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907551:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791462656:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907590:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788725878.907594:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791461504:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907635:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791462016:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907666:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791462528:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725878.907707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461632 00000100:00100000:0.0:1788725878.907715:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461632 00000100:00100000:0.0:1788725878.907753:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462016 00000100:00100000:0.0:1788725878.907756:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462016 00000100:00100000:0.0:1788725878.907779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462528 00000100:00100000:0.0:1788725878.907782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462528 00000100:00100000:0.0:1788725878.907810:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788725878.907820:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791461632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.907870:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791461632:12345-0@lo:400:kworker.0 Request processed in 51us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725878.907877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788725878.908032:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788725878.908042:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791462016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908073:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791462016:12345-0@lo:400:kworker.0 Request processed in 34us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.908079:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788725878.908091:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788725878.908096:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791462528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908140:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791462528:12345-0@lo:400:kworker.0 Request processed in 44us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.908146:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788725878.908319:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462144 00000100:00100000:3.0:1788725878.908324:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462144 00000100:00100000:3.0:1788725878.908352:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462656 00000100:00100000:3.0:1788725878.908355:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462656 00000100:00100000:3.0:1788725878.908374:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788725878.908381:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791462144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908413:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791462144:12345-0@lo:400:kworker.0 Request processed in 33us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.908419:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788725878.908431:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788725878.908437:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791462656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788725878.908498:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725878.908505:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725878.908508:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788725878.908533:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a5c00 x1875614791462016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725878.908547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791462016:0@lo:400:kworker.0 00010000:00080000:0.0:1788725878.908557:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283684e00 x1875614791462528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725878.908565:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791462528:0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.908573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791461632:0@lo:400:kworker.0 00010000:00080000:0.0:1788725878.908581:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be8a7b80 x1875614791462144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725878.908596:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791462144:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908614:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791462656:12345-0@lo:400:kworker.0 Request processed in 177us (1042us total) trans 0 rc 0/0 00010000:00080000:0.0:1788725878.908623:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283686680 x1875614791462656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725878.908626:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788725878.908631:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791462656:0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.908816:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791461248:0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.908850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725878.908879:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725878.908881:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791461760:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908888:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725878.908920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725878.908920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725878.908938:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791462272:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908944:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461504 00000100:00100000:3.0:1788725878.908948:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461504 00000100:00100000:1.0:1788725878.908959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725878.908971:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461760 00000100:00100000:3.0:1788725878.908973:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461760 00000100:00100000:1.0:1788725878.908974:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791462784:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.908986:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788725878.908992:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791461504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.909003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725878.909019:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788725878.909025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791461376:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909028:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791461504:12345-0@lo:400:kworker.0 Request processed in 36us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909033:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788725878.909044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725878.909045:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788725878.909051:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791461760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.909059:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791461888:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909076:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791461760:12345-0@lo:400:kworker.0 Request processed in 26us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725878.909076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725878.909082:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788725878.909098:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463040 00000100:00100000:1.0:1788725878.909099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791462400:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909101:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463040 00000100:00100000:1.0:1788725878.909137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725878.909146:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788725878.909151:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791462912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725878.909153:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725878.909169:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788725878.909171:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725878.909190:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791461760:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909195:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909201:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788725878.909211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461376 00000100:00100000:1.0:1788725878.909213:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461376 00000100:00100000:3.0:1788725878.909216:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462912 00000100:00100000:3.0:1788725878.909218:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462912 00000100:00100000:3.0:1788725878.909229:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788725878.909234:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791462912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725878.909234:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461888 00000100:00100000:1.0:1788725878.909236:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461888 00002000:00000024:3.0:1788725878.909244:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725878.909247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462400 00000100:00100000:1.0:1788725878.909249:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462400 00000100:00100000:1.0:1788725878.909262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788725878.909267:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791461376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909271:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791462912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909277:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788725878.909295:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791461376:12345-0@lo:400:kworker.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725878.909301:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788725878.909309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788725878.909312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788725878.909315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791461888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.909317:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791462400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791461888:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725878.909341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791462400:12345-0@lo:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909347:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788725878.909361:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725878.909364:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725878.909374:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462272 00000100:00100000:3.0:1788725878.909378:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462272 00000100:00100000:3.0:1788725878.909399:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791462784 00000100:00100000:3.0:1788725878.909401:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791462784 00000100:00100000:3.0:1788725878.909414:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788725878.909420:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791462272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.909456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791461248 00000100:00100000:0.0:1788725878.909460:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791461248 00000100:00100000:3.0:1788725878.909462:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791462272:12345-0@lo:400:kworker.0 Request processed in 43us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909468:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788725878.909477:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788725878.909483:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791462784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725878.909485:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788725878.909490:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791461248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909509:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791462784:12345-0@lo:400:kworker.0 Request processed in 26us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725878.909514:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791461248:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725878.909520:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788725878.909520:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:3.0:1788725878.909538:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725878.909559:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791461376:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909569:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791461888:0@lo:400:kworker.0 00000100:00100000:3.0:1788725878.909577:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791462400:0@lo:400:kworker.0 00010000:00080000:3.0:1788725878.909586:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367c380 x1875614791462912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725878.909599:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791462912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725878.909606:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791461248:0@lo:400:kworker.0 00010000:00080000:3.0:1788725878.909614:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283685c00 x1875614791462272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725878.909621:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791462272:0@lo:400:kworker.0 00010000:00080000:3.0:1788725878.909629:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283687b80 x1875614791462784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725878.909636:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791462784:0@lo:400:kworker.0 00010000:00080000:3.0:1788725878.909668:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367df80 x1875614791463040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725878.909678:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725878.909687:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791461504:0@lo:400:kworker.0 00000100:00100000:1.0:1788725878.910577:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00010000:0.0:1788725879.675404:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725879.939419:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725879.939500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725879.943450:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463168 00000100:00100000:3.0:1788725879.943466:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463168 00000100:00100000:3.0:1788725879.943520:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788725879.943531:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725879.943567:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725879.943857:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 328us (4356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725879.943866:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788725879.945393:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463168:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788725880.552015:0:12885:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788725880.552364:0:12885:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788725880.700756:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725881.471522:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791463296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725881.471648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725881.471830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463296 00000100:00100000:0.0:1788725881.471943:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463296 00000100:00100000:0.0:1788725881.472000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788725881.472011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791463296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725881.472047:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725881.472104:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791463296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725881.472112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788725881.472201:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791463296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725881.725456:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725881.979437:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791463424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725881.979535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725881.979602:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463424 00000100:00100000:2.0:1788725881.979611:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463424 00000100:00080000:3.0:1788725881.979650:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725881.979678:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725881.979689:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791463424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725881.979719:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725881.979795:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791463424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725881.979804:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788725881.979820:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82a300 x1875614791463424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725881.979841:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791463424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725881.981381:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725881.981400:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725881.981478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725881.982328:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463552 00000100:00100000:0.0:1788725881.982339:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463552 00000100:00100000:0.0:1788725881.982473:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788725881.982484:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788725881.982523:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725881.982585:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791463552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725881.982592:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788725881.982636:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767fb80 x1875614791463552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725881.982655:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791463552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788725881.983708:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725882.045036:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725882.046957:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770413952 00000100:00100000:0.0:1788725882.046972:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770413952 00000100:00100000:0.0:1788725882.047040:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 309 00000100:00100000:0.0:1788725882.047051:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770413952:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725882.047185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770413952:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 135us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725882.047192:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 309 00000100:00100000:0.0:1788725882.050419:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725882.050458:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725882.050584:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414592 00000100:00100000:3.0:1788725882.050594:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414592 00000100:00100000:3.0:1788725882.050656:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414720 00000100:00100000:3.0:1788725882.050659:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414720 00000100:00100000:3.0:1788725882.050681:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725882.050692:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2394:x1875614770414592:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788725882.050720:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36f43 00000100:00080000:3.0:1788725882.050740:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b139f7c8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788725882.050784:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788725882.050951:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+2:2394:x1875614770414592:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 261us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725882.050959:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725882.050974:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788725882.050997:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2394:x1875614770414720:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788725882.051009:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36f4a 00000100:00080000:3.0:1788725882.051015:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b139f7ce000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788725882.051038:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788725882.051112:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed75931d-dab3-4684-a02c-ea7022155724+2:2394:x1875614770414720:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 115us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725882.051151:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00010000:00010000:3.0:1788725882.051177:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725882.051182:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788725882.052161:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725882.052169:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725882.053454:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725882.053494:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725882.053515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725882.053541:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725882.053607:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414080 00000100:00100000:1.0:1788725882.053617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414080 00000100:00100000:1.0:1788725882.053678:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414336 00000100:00100000:1.0:1788725882.053682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414336 00000100:00100000:1.0:1788725882.053698:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414208 00000100:00100000:1.0:1788725882.053700:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414208 00000100:00100000:1.0:1788725882.053711:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414464 00000100:00100000:1.0:1788725882.053714:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414464 00000100:00100000:1.0:1788725882.053739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1788725882.053749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770414080:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725882.053817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770414080:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725882.053824:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1788725882.053841:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:1.0:1788725882.053847:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770414336:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725882.053872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770414336:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725882.053887:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:1.0:1788725882.053899:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788725882.053916:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770414208:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725882.053944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770414208:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725882.053950:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:1.0:1788725882.053962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788725882.053968:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770414464:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725882.053989:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770414464:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725882.053995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00080000:3.0:1788725882.054156:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725882.054160:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788725882.747992:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725883.771663:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725884.029242:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725884.029283:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791463680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725884.029376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.029457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791463808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725884.029484:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.029523:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463680 00000100:00100000:0.0:1788725884.029544:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463680 00000100:00100000:0.0:1788725884.029620:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463808 00000100:00100000:0.0:1788725884.029624:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463808 00000100:00100000:0.0:1788725884.029652:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788725884.029664:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791463680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725884.029704:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725884.029756:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791463680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.029763:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788725884.029782:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788725884.029788:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791463808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725884.029798:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725884.029819:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791463808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.029825:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788725884.029844:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725884.029858:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791463936:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.029904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.029939:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791464448:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.029964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.029984:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791464960:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.030033:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788725884.030037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791463936 00000100:00100000:0.0:1788725884.030040:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791464320:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.030044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791463936 00000100:00100000:0.0:1788725884.030074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725884.030084:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788725884.030093:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791463936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030104:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791464832:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.030177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791463936:12345-0@lo:400:kworker.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.030186:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725884.030190:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788725884.030234:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791463936:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030266:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464448 00000100:00100000:0.0:1788725884.030270:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464448 00000100:00100000:0.0:1788725884.030308:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788725884.030315:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791464448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030355:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791464448:12345-0@lo:400:kworker.0 Request processed in 40us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.030361:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788725884.030380:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464960 00000100:00100000:0.0:1788725884.030384:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464960 00000100:00100000:0.0:1788725884.030416:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464832 00000100:00100000:0.0:1788725884.030419:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464832 00000100:00100000:0.0:1788725884.030438:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788725884.030444:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791464960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030478:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791464960:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.030483:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788725884.030494:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788725884.030500:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030526:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791464832:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.030531:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788725884.030559:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725884.030579:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a07800 x1875614791463808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725884.030611:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791463808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725884.030635:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791464064:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.030693:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791464576:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.030730:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791465088:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788725884.030773:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367f800 x1875614791463680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725884.030785:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791463680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725884.030798:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788725884.030803:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791464192:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.030845:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791464704:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.030877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725884.030895:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791465216:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.030905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464320 00000100:00100000:3.0:1788725884.030911:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464320 00000100:00100000:0.0:1788725884.030922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725884.030942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464064 00000100:00100000:3.0:1788725884.030947:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464064 00000100:00100000:0.0:1788725884.030952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464192 00000100:00100000:0.0:1788725884.030957:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464192 00000100:00100000:0.0:1788725884.030984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788725884.030991:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791464192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791464192:12345-0@lo:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725884.031039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464576 00000100:00100000:3.0:1788725884.031045:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464576 00000100:00100000:0.0:1788725884.031051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788725884.031077:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725884.031087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465088 00000100:00100000:3.0:1788725884.031091:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465088 00010000:00080000:0.0:1788725884.031105:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b5500 x1875614791464832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725884.031138:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791464832:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031139:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791464704 00000100:00100000:3.0:1788725884.031147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791464704 00000100:00100000:0.0:1788725884.031155:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791464448:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031168:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465216 00010000:00080000:0.0:1788725884.031171:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b4e00 x1875614791464960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725884.031173:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465216 00000100:00100000:0.0:1788725884.031184:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791464960:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788725884.031207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791464320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788725884.031209:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725884.031215:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725884.031233:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791464192:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791464320:12345-0@lo:400:kworker.0 Request processed in 54us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.031266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791464320:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788725884.031294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788725884.031301:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791464064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031316:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788725884.031328:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791464576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.031341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791464064:12345-0@lo:400:kworker.0 Request processed in 40us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725884.031348:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788725884.031363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788725884.031374:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791464576:12345-0@lo:400:kworker.0 Request processed in 48us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.031381:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788725884.031398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788725884.031405:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791464704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031432:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791464704:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.031437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788725884.031456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788725884.031462:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791465216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031493:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791465216:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725884.031499:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00080000:0.0:1788725884.031520:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b4000 x1875614791464704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725884.031529:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791464704:0@lo:400:kworker.0 00010000:00080000:0.0:1788725884.031540:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833d9c00 x1875614791465216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725884.031548:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791465216:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031557:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791464064:0@lo:400:kworker.0 00000100:00100000:0.0:1788725884.031567:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791464576:0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.034810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725884.034973:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791465088:12345-0@lo:400:kworker.0 Request processed in 3603us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725884.034985:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788725884.036922:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791465088:0@lo:400:kworker.0 00000001:02000400:1.0:1788725884.536573:0:13030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788725884.798141:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725885.052845:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725885.052888:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791465344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725885.052988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725885.053599:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465344 00000100:00100000:3.0:1788725885.053611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465344 00000100:00100000:3.0:1788725885.053681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788725885.053693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791465344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725885.053739:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725885.053810:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791465344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725885.053834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788725885.054094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791465344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725885.823185:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725886.588345:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725886.588377:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791465472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725886.588472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725886.588555:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465472 00000100:00100000:0.0:1788725886.588564:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465472 00000100:00100000:0.0:1788725886.588626:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788725886.588637:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791465472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725886.588696:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725886.588933:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791465472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 296us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725886.588950:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788725886.589006:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791465472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788725886.847676:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725887.100557:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791465600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725887.100653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.104220:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465600 00000100:00100000:1.0:1788725887.104242:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465600 00000100:00100000:1.0:1788725887.104339:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788725887.104356:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791465600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725887.104399:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725887.108903:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791465728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725887.109010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725887.109179:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791465728 00000100:00100000:3.0:1788725887.109192:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791465728 00000100:00100000:3.0:1788725887.109354:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788725887.109367:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791465728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788725887.109478:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725887.109692:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791465728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 327us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725887.109702:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725887.109730:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791465600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5377us (9073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.109741:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788725887.109755:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833dbb80 x1875614791465728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725887.109783:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791465728:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788725887.110175:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767c000 x1875614791465600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725887.110272:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791465600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725887.111626:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725887.183744:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725887.183793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725887.183825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725887.183861:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725887.183894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725887.183932:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414976 00000100:00100000:0.0:1788725887.183944:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414976 00000100:00100000:0.0:1788725887.184031:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415232 00000100:00100000:0.0:1788725887.184046:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415232 00000100:00100000:0.0:1788725887.184067:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415104 00000100:00100000:0.0:1788725887.184070:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415104 00000100:00100000:0.0:1788725887.184083:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415360 00000100:00100000:0.0:1788725887.184086:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415360 00000100:00100000:0.0:1788725887.184106:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:0.0:1788725887.184153:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770414976:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725887.184499:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770414976:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 381us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.184638:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770414848 00000100:00100000:1.0:1788725887.184644:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770414848 00000100:00100000:1.0:1788725887.184685:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00100000:1.0:1788725887.184694:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770414848:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725887.184738:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770414848:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.184745:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00100000:1.0:1788725887.184821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1788725887.184829:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770415232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725887.184870:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770415232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.184876:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1788725887.184894:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1788725887.184901:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770415104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725887.184926:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770415104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.184932:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1788725887.184946:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1788725887.184953:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770415360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725887.184980:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770415360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.185009:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:0.0:1788725887.185187:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00080000:1.0:1788725887.185316:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725887.185322:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788725887.627849:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000020:00000080:0.0:1788725887.627858:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b139f7cd800/ed75931d-dab3-4684-a02c-ea7022155724 00000020:00000080:3.0:1788725887.627920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f7cd800/ed75931d-dab3-4684-a02c-ea7022155724 for lustre-OST0001 00000020:00000080:3.0:1788725887.627985:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f7ce000 for lustre-OST0001 00000001:00100000:1.0:1788725887.628950:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000020:00000080:1.0:1788725887.628962:0:8420:0:(genops.c:885:class_export_put()) final put ffff9b139f7cf800/ed75931d-dab3-4684-a02c-ea7022155724 00000020:00000080:0.0:1788725887.629059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f7cf800/ed75931d-dab3-4684-a02c-ea7022155724 for lustre-OST0000 00000020:00000080:0.0:1788725887.629146:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f7c8800 for lustre-OST0000 00000020:00000080:2.0:1788725887.813769:0:13177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1efc1450 20000000:00000080:2.0:1788725887.813787:0:13177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b139f7c5c00 uarg=0000000000000000 20000000:01000000:2.0:1788725887.813833:0:13177:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788725887.813847:0:13177:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788725887.813852:0:13177:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788725887.814594:0:13178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788725887.814831:0:13177:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788725887.822868:0:13177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788725887.822898:0:13177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822938:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822946:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822953:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36efd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822960:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f0b expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822969:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822976:0:13177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.822984:0:13177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.823095:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.823108:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 12 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.823302:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791465856:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725887.823415:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.823431:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.823441:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791465984:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725887.823488:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.823497:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.823506:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466112:0@lo:104: 00000100:00100000:2.0:1788725887.823544:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725887.823587:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.823595:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 23 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.823602:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466240:0@lo:104: 00000100:00100000:2.0:1788725887.823621:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.823761:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466240 00000100:00100000:1.0:1788725887.823769:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466240 00000100:00100000:1.0:1788725887.823814:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788725887.823823:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466240:12345-0@lo:104: 00010000:00010000:1.0:1788725887.823848:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.823897:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725887.823903:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466240:12345-0@lo:104: Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.823910:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788725887.823935:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725887.823942:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.823949:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788725887.823953:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.823961:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725887.823968:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725887.823979:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725887.824019:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.824025:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725887.824045:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.824051:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d36efd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f04 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.824064:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725887.824066:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725887.824067:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725887.824088:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791466368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725887.824138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.824176:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466368 00000100:00100000:1.0:1788725887.824180:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466368 00010000:00010000:1.0:1788725887.824196:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 24 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.824216:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725887.824223:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791466368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725887.824233:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725887.824238:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 24 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.824246:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 24 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.824268:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725887.824316:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791466368:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.824322:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788725887.824355:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791466368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725887.826337:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466112 00000100:00100000:2.0:1788725887.826352:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466112 00000100:00100000:2.0:1788725887.826410:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788725887.826420:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466112:12345-0@lo:104: 00010000:00010000:2.0:1788725887.826436:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.826510:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725887.826527:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466112:12345-0@lo:104: Request processed in 109us (2983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.826535:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1788725887.826601:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.826616:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.826627:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466496:0@lo:104: 00010000:00010000:1.0:1788725887.826831:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725887.826846:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.826855:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788725887.826859:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.826868:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725887.826876:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725887.826883:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725887.826911:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.826917:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788725887.826934:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.826941:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148ba00/0xa13c582691d36f0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f12 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.826962:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725887.826963:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725887.826965:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725887.826978:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791466624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725887.827019:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.827059:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466624 00000100:00100000:1.0:1788725887.827063:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466624 00010000:00010000:1.0:1788725887.827081:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 24 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.827103:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725887.827109:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791466624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725887.827141:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725887.827147:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 24 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.827156:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 24 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.827171:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725887.827197:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791466624:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.827204:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725887.827240:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791466624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725887.827667:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725887.827711:0:13177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.827722:0:13177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 23 pid: 6505 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.827732:0:13177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466752:0@lo:104: 00000100:00100000:2.0:1788725887.827757:0:13177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725887.827780:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466496 00000100:00100000:2.0:1788725887.827784:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466496 00000100:00100000:2.0:1788725887.827803:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466752 00000100:00100000:2.0:1788725887.827806:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466752 00000100:00100000:2.0:1788725887.827817:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788725887.827823:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13177:x1875614791466496:12345-0@lo:104: 00010000:00010000:2.0:1788725887.827831:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.827877:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788725887.827883:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13177:x1875614791466496:12345-0@lo:104: Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.827898:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788725887.827911:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788725887.827917:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466752:12345-0@lo:104: 00010000:00010000:2.0:1788725887.827925:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.827954:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788725887.827959:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13177:x1875614791466752:12345-0@lo:104: Request processed in 43us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.827964:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788725887.827978:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725887.827982:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828001:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725887.828005:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828012:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725887.828018:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725887.828024:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788725887.828042:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828049:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725887.828069:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828076:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148ac00/0xa13c582691d36eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ef6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828088:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725887.828091:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828097:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725887.828100:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828107:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725887.828135:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725887.828141:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788725887.828155:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828160:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725887.828166:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828173:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148b600/0xa13c582691d36ee1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36ee8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.828185:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725887.828192:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725887.828194:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725887.828208:0:13177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788725887.828225:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af600/0xa13c582691d36f12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36f0b expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.828234:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466112:0@lo:104: 00010000:00010000:2.0:1788725887.828244:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af000/0xa13c582691d36f04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36efd expref: 22 pid: 6506 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.828252:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466240:0@lo:104: 00000100:00100000:2.0:1788725887.828259:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466496:0@lo:104: 00000100:00100000:2.0:1788725887.828266:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791466752:0@lo:104: 00000100:00100000:1.0:1788725887.828443:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791466880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725887.828485:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.828519:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725887.828525:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791467008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725887.828546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725887.828569:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791466880 00000100:00100000:1.0:1788725887.828572:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791466880 00010000:00010000:1.0:1788725887.828589:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 22 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.828607:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467008 00000100:00100000:1.0:1788725887.828609:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467008 00010000:00010000:1.0:1788725887.828619:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 23 pid: 6505 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.828634:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788725887.828640:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3638:x1875614791466880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725887.828659:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725887.828663:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828672:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828684:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6afa00/0xa13c582691d36ef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36eef expref: 23 pid: 6504 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828694:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725887.828720:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3638:x1875614791466880:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.828727:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788725887.828739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725887.828751:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791467008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725887.828760:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725887.828764:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 21 pid: 6505 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828772:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 21 pid: 6505 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828782:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030400/0xa13c582691d36ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36ee1 expref: 21 pid: 6505 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.828792:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725887.828813:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3638:x1875614791467008:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725887.828819:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725887.828868:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791467008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725887.828876:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791466880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725887.828893:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725887.834193:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791465856:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725887.834228:0:13177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13177:1875614791465984:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725887.834271:0:13177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725887.836318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725887.836411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725887.836476:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415488 00000100:00100000:2.0:1788725887.836485:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415488 00010000:00010000:2.0:1788725887.836524:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 13 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.836558:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415616 00000100:00100000:2.0:1788725887.836560:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415616 00010000:00010000:2.0:1788725887.836570:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 14 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725887.836592:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788725887.836614:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+14:2396:x1875614770415488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725887.836627:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725887.836633:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 14 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836644:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 14 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836674:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af400/0xa13c582691d36f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d0f expref: 14 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836691:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725887.836744:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770415488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.836751:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788725887.836770:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788725887.836777:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:2396:x1875614770415616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725887.836785:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725887.836790:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836798:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836808:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af200/0xa13c582691d36f19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd0 expref: 12 pid: 6505 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836818:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836833:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836857:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836864:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836872:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836878:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836884:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788725887.836888:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836895:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836912:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.836922:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725887.836943:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:2396:x1875614770415616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 167us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725887.836950:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00010000:00010000:2.0:1788725887.837315:0:13177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.837330:0:13177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725887.837335:0:13177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659600/0xa13c582691d36f51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725887.867901:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725888.892292:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788725889.021913:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788725889.021921:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1282214000 from 7 10000000:01000000:0.0:1788725889.021927:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788725889.021975:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.021987:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.021998:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725889.022024:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.022094:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.022179:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725889.022748:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467136 00000100:00100000:1.0:1788725889.022758:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467136 00000100:00100000:1.0:1788725889.022823:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788725889.022842:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791467136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725889.022857:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725889.022871:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36f58 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.022923:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36f58 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.022933:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f58 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.022942:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ba00, rc 0) 00000100:00100000:1.0:1788725889.022987:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.022994:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788725889.023680:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725889.023701:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.023710:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725889.024380:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.024423:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.024542:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725889.024576:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467264 00000100:00100000:1.0:1788725889.024582:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467264 00000100:00100000:1.0:1788725889.024743:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788725889.024753:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.025756:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 999us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.025766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788725889.025813:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.025875:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.025928:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725889.025961:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788725889.026049:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467392 00000100:00100000:1.0:1788725889.026054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467392 00000100:00100000:1.0:1788725889.026092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788725889.026100:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.026430:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 330us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.026437:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788725889.026587:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788725889.031769:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788725889.035431:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788725889.035468:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725889.035479:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.035491:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725889.035569:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788725889.035573:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e52d000 from 7 10000000:01000000:3.0:1788725889.035577:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725889.035616:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.035626:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.035654:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725889.035680:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.035743:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.035797:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725889.035918:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467520 00000100:00100000:0.0:1788725889.035925:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467520 00000100:00100000:0.0:1788725889.035971:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788725889.035979:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791467520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788725889.035998:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725889.036010:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36f66 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.036032:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36f66 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.036042:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f66 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725889.036049:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6afc00, rc 0) 00000100:00100000:0.0:1788725889.036092:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.036099:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788725889.036516:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725889.036530:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.036539:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725889.036597:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.036624:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.036653:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725889.038878:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467648 00000100:00100000:0.0:1788725889.038890:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467648 00000100:00100000:0.0:1788725889.038952:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788725889.038960:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.039108:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.039143:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788725889.039300:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.039348:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.039397:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.039421:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.039626:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467776 00000100:00100000:2.0:1788725889.039631:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467776 00000100:00100000:2.0:1788725889.039665:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788725889.039673:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.039748:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.039753:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788725889.039848:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788725889.045642:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788725889.046794:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788725889.046820:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725889.046840:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.046852:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725889.046862:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725889.046864:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b13bd660800 from 7 10000000:01000000:2.0:1788725889.046867:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725889.047059:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.047069:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.047080:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725889.047107:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.047362:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.047409:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.047690:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791467904 00000100:00100000:2.0:1788725889.047698:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791467904 00000100:00100000:2.0:1788725889.047749:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788725889.047759:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791467904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725889.047772:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725889.047795:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36f74 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.047843:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.047866:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.047874:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659e00, rc 0) 00000100:00100000:2.0:1788725889.047924:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791467904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.047932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788725889.052374:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791467904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725889.052412:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.052425:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725889.052506:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.052561:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.052601:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.055156:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468032 00000100:00100000:2.0:1788725889.055171:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468032 00000100:00100000:2.0:1788725889.055228:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788725889.055238:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791468032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.055396:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791468032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.055404:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788725889.055823:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.055883:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.055945:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.055986:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.056237:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468160 00000100:00100000:2.0:1788725889.056242:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468160 00000100:00100000:2.0:1788725889.056269:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788725889.056277:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791468160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.056360:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791468160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.056367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788725889.056518:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788725889.057656:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788725889.057888:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788725889.058035:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725889.058045:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058066:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725889.058076:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725889.058079:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139116a000 from 7 10000000:01000000:2.0:1788725889.058082:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725889.058114:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058424:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058435:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725889.058476:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725889.058530:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.058576:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.058610:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468288 00000100:00100000:2.0:1788725889.058616:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468288 00000100:00100000:2.0:1788725889.058694:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788725889.058703:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791468288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725889.058716:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725889.058727:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d36f82 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058749:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d36f82 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058759:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f82 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.058791:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658e00, rc 0) 00000100:00100000:2.0:1788725889.058848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791468288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.058855:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788725889.058918:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e74b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725889.058942:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.058951:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725889.059007:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.059034:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725889.059221:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725889.059252:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468416 00000100:00100000:0.0:1788725889.059256:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468416 00000100:00100000:0.0:1788725889.059279:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788725889.059285:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791468416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.059596:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791468416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.059610:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788725889.059664:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.059693:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.059730:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725889.059849:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725889.059880:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468544 00000100:00100000:2.0:1788725889.059884:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468544 00000100:00100000:2.0:1788725889.059944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788725889.059951:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791468544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725889.060034:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791468544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.060040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788725889.060100:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791468544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788725889.061292:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788725889.061872:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788725889.061894:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725889.062025:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725889.062038:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725889.147619:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725889.147644:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725889.147710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725889.147803:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468672 00000100:00100000:2.0:1788725889.147810:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468672 00000100:00100000:2.0:1788725889.147887:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788725889.147897:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791468672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725889.147944:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725889.147999:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791468672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.148006:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788725889.148029:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725889.148139:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725889.148151:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725889.148179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.148210:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468800 00000100:00100000:3.0:1788725889.148213:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468800 00000100:00100000:3.0:1788725889.148257:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788725889.148264:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791468800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725889.148285:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725889.148317:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791468800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725889.148323:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788725889.148356:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833dbb80 x1875614791468800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725889.148376:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791468800:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788725889.148637:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b6300 x1875614791468672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725889.148652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725889.151443:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791469184:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.151504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.151545:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791469696:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.151569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.151774:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788725889.151859:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791469312:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.151887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.151906:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791469824:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.151926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725889.151955:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469184 00000100:00100000:0.0:1788725889.151962:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469184 00000100:00100000:0.0:1788725889.152006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788725889.152015:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791469184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.152062:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791469184:12345-0@lo:400:kworker.0 Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.152068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788725889.152092:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469696 00000100:00100000:0.0:1788725889.152096:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469696 00000100:00100000:3.0:1788725889.152350:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791469056:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.152403:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791469568:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.152442:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791470080:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.152479:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788725889.152485:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.152519:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791469440:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725889.152556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791469952:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.152578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725889.152583:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469568 00000100:00100000:1.0:1788725889.152589:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469568 00000100:00100000:1.0:1788725889.152623:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470080 00000100:00100000:1.0:1788725889.152626:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470080 00000100:00100000:1.0:1788725889.152638:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791468928 00000100:00100000:1.0:1788725889.152640:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791468928 00000100:00100000:1.0:1788725889.152649:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469440 00000100:00100000:1.0:1788725889.152651:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469440 00000100:00100000:1.0:1788725889.152659:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469952 00000100:00100000:1.0:1788725889.152672:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469952 00000100:00100000:1.0:1788725889.152686:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788725889.152692:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791469568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.152769:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469824 00000100:00100000:0.0:1788725889.152774:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469824 00000100:00100000:0.0:1788725889.152812:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788725889.152820:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791469696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788725889.153982:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725889.153988:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725889.153991:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725889.153993:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725889.154280:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788725889.154295:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791470080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.154801:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791469568:12345-0@lo:400:kworker.0 Request processed in 2104us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.154811:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:3.0:1788725889.154842:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b4000 x1875614791469568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725889.154851:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788725889.154865:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791469568:0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.154866:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791468928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155048:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791468928:12345-0@lo:400:kworker.0 Request processed in 187us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155056:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788725889.155069:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788725889.155077:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791469440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.155429:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791468928:0@lo:400:kworker.0 00000100:00100000:3.0:1788725889.155445:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791469440:0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155449:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791469440:12345-0@lo:400:kworker.0 Request processed in 369us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155458:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788725889.155475:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788725889.155483:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791469952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155527:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791469952:12345-0@lo:400:kworker.0 Request processed in 45us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155534:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788725889.155552:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791469952:0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155564:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788725889.155575:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155609:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791469824:12345-0@lo:400:kworker.0 Request processed in 37us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155692:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788725889.155718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469312 00000100:00100000:1.0:1788725889.155725:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469312 00000100:00100000:2.0:1788725889.155736:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791470080:12345-0@lo:400:kworker.0 Request processed in 1443us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725889.155746:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788725889.155760:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791469056 00000100:00100000:1.0:1788725889.155764:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791469056 00000100:00100000:1.0:1788725889.155779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788725889.155784:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791469312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155817:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791469312:12345-0@lo:400:kworker.0 Request processed in 32us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788725889.155847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788725889.155854:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791469056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.155885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791469056:12345-0@lo:400:kworker.0 Request processed in 32us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.155891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788725889.155947:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791469056:0@lo:400:kworker.0 00010000:00080000:3.0:1788725889.155960:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af866a00 x1875614791470080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725889.155970:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af866a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791470080:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.156036:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791469696:12345-0@lo:400:kworker.0 Request processed in 3216us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.156055:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788725889.156073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791469312:0@lo:400:kworker.0 00010000:00080000:1.0:1788725889.156092:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af864a80 x1875614791469824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725889.156102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791469824:0@lo:400:kworker.0 00000100:00100000:1.0:1788725889.156184:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791469184:0@lo:400:kworker.0 00010000:00080000:1.0:1788725889.156202:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128367f800 x1875614791469696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725889.156212:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791469696:0@lo:400:kworker.0 00000100:00100000:0.0:1788725889.412924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725889.416031:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415744 00000100:00100000:1.0:1788725889.416057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415744 00000100:00100000:1.0:1788725889.416192:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:1.0:1788725889.416204:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+11:6168:x1875614770415744:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725889.416220:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725889.416237:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d40 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.416264:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.416275:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725889.416285:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a800, rc 0) 00000100:00100000:1.0:1788725889.416361:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770415744:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 158us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.416367:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 324 00000100:00100000:3.0:1788725889.420265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725889.425025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770415872 00000100:00100000:0.0:1788725889.425041:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770415872 00000100:00100000:0.0:1788725889.425103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:0.0:1788725889.425113:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770415872:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.425280:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770415872:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 167us (5025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.425288:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 325 00000100:00100000:1.0:1788725889.429772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725889.429849:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416000 00000100:00100000:0.0:1788725889.429860:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416000 00000100:00100000:0.0:1788725889.429909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 326 00000100:00100000:0.0:1788725889.429919:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770416000:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.430104:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770416000:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 185us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.430112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 326 00000100:00100000:0.0:1788725889.445045:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725889.446470:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416128 00000100:00100000:3.0:1788725889.446482:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416128 00000100:00100000:3.0:1788725889.446583:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:3.0:1788725889.446594:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770416128:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725889.446610:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725889.446627:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d47 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.446651:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.446661:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725889.446670:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380031a00, rc 0) 00000100:00100000:3.0:1788725889.446740:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770416128:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 147us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725889.446756:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:0.0:1788725889.451592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725889.452950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416256 00000100:00100000:1.0:1788725889.452963:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416256 00000100:00100000:1.0:1788725889.453093:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:1.0:1788725889.453106:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770416256:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725889.453278:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770416256:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 174us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725889.453286:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:3.0:1788725889.456735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725889.460015:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416384 00000100:00100000:0.0:1788725889.460030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416384 00000100:00100000:0.0:1788725889.460093:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:0.0:1788725889.460104:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770416384:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725889.464742:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770416384:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 4617us (8003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725889.464757:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 329 00010000:00010000:1.0:1788725889.915361:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725890.178794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791470208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725890.178876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725890.181560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470208 00000100:00100000:1.0:1788725890.182017:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470208 00000100:00100000:1.0:1788725890.182087:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788725890.182097:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791470208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725890.182261:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725890.182337:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791470208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 242us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725890.182345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788725890.183852:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791470208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725890.939266:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788725891.371644:0:13376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788725891.717900:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725891.717931:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791470336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725891.718005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725891.718245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470336 00000100:00100000:0.0:1788725891.718254:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470336 00000100:00100000:0.0:1788725891.718305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788725891.718315:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791470336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725891.718348:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725891.718409:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791470336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725891.718417:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788725891.718504:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791470336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725891.963568:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725892.219361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791470464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725892.219434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725892.219545:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470464 00000100:00100000:2.0:1788725892.219554:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470464 00000100:00100000:2.0:1788725892.219610:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788725892.219620:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791470464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725892.219649:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788725892.219734:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725892.220350:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791470592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725892.220387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725892.220432:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470592 00000100:00100000:1.0:1788725892.220448:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470592 00000100:00100000:1.0:1788725892.220485:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788725892.220494:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791470592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725892.220506:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725892.220540:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791470592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725892.220546:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788725892.220563:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725892.220586:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b5500 x1875614791470592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725892.220602:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791470592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725892.223411:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791470464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3783us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.223425:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788725892.225462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b5180 x1875614791470464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725892.225490:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791470464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725892.292311:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725892.292365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725892.292395:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725892.292499:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725892.292555:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416512 00000100:00100000:2.0:1788725892.292566:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416512 00000100:00100000:2.0:1788725892.292621:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 330 00000100:00100000:2.0:1788725892.292631:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770416512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725892.292725:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770416512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725892.292733:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 330 00000100:00100000:0.0:1788725892.297990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725892.302033:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416768 00000100:00100000:3.0:1788725892.302048:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416768 00000100:00100000:3.0:1788725892.302144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417024 00000100:00100000:3.0:1788725892.302148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417024 00000100:00100000:3.0:1788725892.302172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416640 00000100:00100000:3.0:1788725892.302175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416640 00000100:00100000:3.0:1788725892.302195:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788725892.302205:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770416768:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725892.302288:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770416768:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (9922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725892.302296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788725892.302313:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:3.0:1788725892.302320:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770417024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725892.302347:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770417024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (9952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725892.302361:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:3.0:1788725892.302374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:1.0:1788725892.302380:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770416640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:3.0:1788725892.302409:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725892.302414:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725892.302537:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770416640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 165us (10038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725892.302545:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:1.0:1788725892.302821:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770416896 00000100:00100000:1.0:1788725892.302826:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770416896 00000100:00100000:1.0:1788725892.302871:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:1.0:1788725892.302879:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770416896:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:0.0:1788725892.302964:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725892.303172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770416896:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 293us (5190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725892.303178:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00010000:00010000:1.0:1788725892.988614:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725894.012736:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725894.267557:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791470976:0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.267633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725894.267650:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791471104:0@lo:400:kworker.0 00000100:00100000:3.0:1788725894.267690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725894.267699:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791471488:0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.267728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725894.267732:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791471616:0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.267755:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791472000:0@lo:400:kworker.0 00000100:00100000:3.0:1788725894.267763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725894.267786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725894.267803:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791472128:0@lo:400:kworker.0 00000100:00100000:3.0:1788725894.267833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725894.267877:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471104 00000100:00100000:3.0:1788725894.267884:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471104 00000100:00100000:3.0:1788725894.267932:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788725894.267943:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.267961:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791470720:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.268000:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725894.268027:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791471104:12345-0@lo:400:kworker.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725894.268035:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788725894.268044:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791471360:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.268074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.268092:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791471872:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.268114:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.268155:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791472384:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.268175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.268193:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788725894.268198:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791470848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725894.268219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.268499:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791471232:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.268523:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.275904:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791471744:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.275967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.275995:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791472256:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.276016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.276086:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471872 00000100:00100000:2.0:1788725894.276093:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471872 00000100:00100000:2.0:1788725894.276152:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472384 00000100:00100000:2.0:1788725894.276156:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472384 00000100:00100000:2.0:1788725894.276169:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471744 00000100:00100000:2.0:1788725894.276184:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471744 00000100:00100000:2.0:1788725894.276201:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472256 00000100:00100000:2.0:1788725894.276204:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472256 00000100:00100000:2.0:1788725894.276218:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788725894.276228:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791471872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.276297:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791471872:12345-0@lo:400:kworker.0 Request processed in 70us (8181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.276305:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788725894.276322:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788725894.276328:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791472384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.276365:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791472384:12345-0@lo:400:kworker.0 Request processed in 27us (8179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.276372:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788725894.276383:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788725894.276389:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791471744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.276412:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791471744:12345-0@lo:400:kworker.0 Request processed in 24us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.276418:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788725894.276427:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725894.276432:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791472256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.276457:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791472256:12345-0@lo:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.276462:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725894.276484:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470848 00000100:00100000:2.0:1788725894.276487:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470848 00000100:00100000:2.0:1788725894.276511:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725894.276518:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791470848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725894.276958:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725894.276996:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791470848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 479us (8776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.277003:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788725894.277080:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725894.277085:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725894.277133:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b4e00 x1875614791470848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277156:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791470848:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788725894.277169:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7ad880 x1875614791471744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277177:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791471744:0@lo:400:kworker.0 00010000:00080000:2.0:1788725894.277187:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7ae300 x1875614791472256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277194:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791472256:0@lo:400:kworker.0 00010000:00080000:2.0:1788725894.277204:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7adc00 x1875614791471872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277212:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791471872:0@lo:400:kworker.0 00010000:00080000:2.0:1788725894.277220:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7af800 x1875614791472384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277227:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791472384:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.277346:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471360 00000100:00100000:2.0:1788725894.277352:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471360 00000100:00100000:2.0:1788725894.277452:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788725894.277459:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791471360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.277501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791471360:12345-0@lo:400:kworker.0 Request processed in 41us (9425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.277507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788725894.277534:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791471104:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.277545:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725894.277556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791472512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725894.277582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725894.277608:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472512 00000100:00100000:2.0:1788725894.277612:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472512 00000100:00100000:2.0:1788725894.277632:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788725894.277638:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791472512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725894.277649:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725894.277674:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791472512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.277680:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788725894.277703:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7ac700 x1875614791472512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725894.277715:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791472512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725894.277736:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791471360:0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.277758:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470720 00000100:00100000:2.0:1788725894.277762:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470720 00000100:00100000:2.0:1788725894.277785:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788725894.277791:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791470720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725894.277845:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791470720:12345-0@lo:400:kworker.0 Request processed in 54us (9844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725894.277851:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788725894.277883:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791470720:0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.278976:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791470976 00000100:00100000:1.0:1788725894.278985:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791470976 00000100:00100000:1.0:1788725894.279089:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471488 00000100:00100000:1.0:1788725894.279094:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471488 00000100:00080000:1.0:1788725894.279131:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725894.279149:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471616 00000100:00100000:1.0:1788725894.279152:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471616 00000100:00080000:1.0:1788725894.279164:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725894.279175:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472000 00000100:00100000:1.0:1788725894.279188:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472000 00000100:00080000:1.0:1788725894.279202:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725894.279216:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472128 00000100:00100000:1.0:1788725894.279219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472128 00000100:00080000:1.0:1788725894.279229:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725894.279240:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791471232 00000100:00100000:1.0:1788725894.279242:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791471232 00000100:00100000:1.0:1788725894.279441:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788725894.279452:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791470976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279514:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791470976:12345-0@lo:400:kworker.0 Request processed in 66us (11882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279521:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788725894.279536:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788725894.279543:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791471488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279567:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791471488:12345-0@lo:400:kworker.0 Request processed in 25us (11839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788725894.279584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788725894.279590:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791471616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791471616:12345-0@lo:400:kworker.0 Request processed in 32us (11858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279627:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788725894.279637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788725894.279643:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791472000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279665:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791472000:12345-0@lo:400:kworker.0 Request processed in 23us (11880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279671:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788725894.279689:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788725894.279695:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279722:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791472128:12345-0@lo:400:kworker.0 Request processed in 27us (11889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788725894.279738:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788725894.279744:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791471232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.279773:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791471232:12345-0@lo:400:kworker.0 Request processed in 29us (11249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725894.279779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:1.0:1788725894.279829:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7ad500 x1875614791471616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725894.279845:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791471616:0@lo:400:kworker.0 00010000:00080000:1.0:1788725894.279856:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7ad180 x1875614791472128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725894.279865:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791472128:0@lo:400:kworker.0 00000100:00100000:0.0:1788725894.280227:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791470976:0@lo:400:kworker.0 00000100:00100000:0.0:1788725894.280239:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791471488:0@lo:400:kworker.0 00000100:00100000:0.0:1788725894.280248:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791472000:0@lo:400:kworker.0 00000100:00100000:1.0:1788725894.280550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791471232:0@lo:400:kworker.0 00010000:00010000:0.0:1788725895.035274:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725895.292502:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791472640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725895.292577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725895.292771:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472640 00000100:00100000:1.0:1788725895.292780:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472640 00000100:00100000:1.0:1788725895.292844:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788725895.292854:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791472640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725895.292895:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725895.292950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791472640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725895.292965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788725895.293105:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791472640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725896.059476:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725896.827592:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791472768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725896.827670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725896.827767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472768 00000100:00100000:0.0:1788725896.827774:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472768 00000100:00100000:0.0:1788725896.827829:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788725896.827837:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791472768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725896.827867:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725896.827911:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791472768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725896.827918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788725896.827955:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791472768:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788725896.842417:0:13525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:18:14 (1788725894) === 00000100:00100000:2.0:1788725897.064241:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.064294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725897.064455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417280 00000100:00100000:3.0:1788725897.064471:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417280 00000100:00100000:1.0:1788725897.064483:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417152 00000100:00100000:1.0:1788725897.064497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417152 00000100:00100000:3.0:1788725897.064578:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788725897.064580:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725897.064611:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:78ae299a-14d0-4856-aa24-442bf24804dd+7:10492:x1875614770417280:12345-192.168.203.12@tcp:700:mkdir.0 00000100:00100000:1.0:1788725897.064612:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770417152:12345-192.168.203.12@tcp:41:mkdir.0 00000004:00000024:1.0:1788725897.064666:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788725897.064745:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:78ae299a-14d0-4856-aa24-442bf24804dd+7:10492:x1875614770417280:12345-192.168.203.12@tcp:700:mkdir.0 Request processed in 150us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.064762:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770417152:12345-192.168.203.12@tcp:41:mkdir.0 Request processed in 167us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.064790:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725897.064802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00080000:0.0:1788725897.064923:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725897.069940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.071625:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417536 00000100:00100000:1.0:1788725897.071640:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417536 00000100:00100000:1.0:1788725897.071707:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788725897.071717:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:10492:x1875614770417536:12345-192.168.203.12@tcp:36:mkdir.0 00010000:00010000:1.0:1788725897.071773:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725897.071860:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d36e40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cbb expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.071883:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725897.071909:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725897.071993:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.072006:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.072015:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.073401:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.073418:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.073430:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.073997:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074008:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074016:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725897.074032:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056026223 reply state 000000002b926999 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074043:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074049:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:1.0:1788725897.074052:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725897.074056:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788725897.074061:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788725897.074068:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074074:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074087:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074093:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.074097:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074105:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074144:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283236500) 00010000:00010000:1.0:1788725897.074147:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.074151:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074156:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36f9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725897.074173:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056026223 reply state 000000002b926999 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074181:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.074187:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283236300) 00010000:00010000:1.0:1788725897.074189:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725897.074191:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788725897.074298:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:10492:x1875614770417536:12345-192.168.203.12@tcp:36:mkdir.0 Request processed in 2579us (4369us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788725897.074306:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788725897.084522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.084664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417664 00000100:00100000:2.0:1788725897.084678:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417664 00000100:00100000:2.0:1788725897.084751:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788725897.084762:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:10493:x1875614770417664:12345-192.168.203.12@tcp:101:chmod.0 00010000:00010000:2.0:1788725897.084794:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725897.084817:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d36fb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d4e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.084882:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.084897:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.084908:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725897.084954:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788725897.084958:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725897.084997:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.085053:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d36fb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d4e expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.085072:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d4e expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.085081:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455a00) 00010000:00010000:2.0:1788725897.085085:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788725897.085088:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658c00, rc 0) 00000100:00100000:2.0:1788725897.085183:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:10493:x1875614770417664:12345-192.168.203.12@tcp:101:chmod.0 Request processed in 422us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.085190:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00010000:00010000:1.0:1788725897.086508:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725897.100491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725897.100625:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770417920 00000100:00100000:0.0:1788725897.100638:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770417920 00000100:00100000:0.0:1788725897.100862:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788725897.100875:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+8:10493:x1875614770417920:12345-192.168.203.12@tcp:36:chmod.0 00010000:00010000:0.0:1788725897.100958:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725897.100997:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d36fba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d4e expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.101022:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455a00) 00010000:00010000:0.0:1788725897.101035:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725897.101069:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.101085:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.101095:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725897.101477:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beb97bb2 reply state 0000000006a2a92e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.101492:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.101499:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:0.0:1788725897.101502:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788725897.101505:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788725897.101515:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788725897.101632:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+9:10493:x1875614770417920:12345-192.168.203.12@tcp:36:chmod.0 Request processed in 758us (1155us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788725897.101640:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788725897.146737:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.147651:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418048 00000100:00100000:1.0:1788725897.147666:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418048 00000100:00100000:1.0:1788725897.147745:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788725897.147755:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+9:10494:x1875614770418048:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:1.0:1788725897.147790:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725897.147812:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d36fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d55 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.150007:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.150029:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.150042:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725897.150088:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788725897.150092:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725897.155653:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.155704:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d36fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d55 expref: 11 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.155725:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d55 expref: 10 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.155734:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:1.0:1788725897.155749:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725897.155753:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b200, rc 0) 00000100:00100000:1.0:1788725897.155833:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+10:10494:x1875614770418048:12345-192.168.203.12@tcp:101:chown.0 Request processed in 8078us (9110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.155841:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788725897.158106:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725897.158427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418176 00000100:00100000:3.0:1788725897.158441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418176 00000100:00100000:3.0:1788725897.158524:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788725897.158537:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+10:10494:x1875614770418176:12345-192.168.203.12@tcp:101:chown.0 00010000:00010000:3.0:1788725897.158567:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725897.158596:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d5c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158690:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158707:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158721:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158733:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158740:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.158746:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159332:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159361:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159370:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725897.159430:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788725897.159434:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725897.159460:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159474:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159480:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159487:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159541:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725897.159546:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159555:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159568:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:3.0:1788725897.159571:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725897.159577:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159595:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d36fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159613:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159764:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159771:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159785:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725897.159789:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159796:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159805:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283236300) 00010000:00010000:3.0:1788725897.159808:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725897.159812:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159818:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d36fe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159868:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d5c expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159887:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d5c expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.159902:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:3.0:1788725897.159905:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788725897.159908:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044a00, rc 0) 00000100:00100000:3.0:1788725897.160047:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+11:10494:x1875614770418176:12345-192.168.203.12@tcp:101:chown.0 Request processed in 1511us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725897.160056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788725897.171817:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.172168:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418304 00000100:00100000:2.0:1788725897.172181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418304 00000100:00100000:2.0:1788725897.172258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788725897.172271:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:78ae299a-14d0-4856-aa24-442bf24804dd+11:10494:x1875614770418304:12345-192.168.203.12@tcp:900:chown.0 00000100:00100000:2.0:1788725897.172393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:78ae299a-14d0-4856-aa24-442bf24804dd+11:10494:x1875614770418304:12345-192.168.203.12@tcp:900:chown.0 Request processed in 124us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.172401:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788725897.177926:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.178025:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418560 00000100:00100000:2.0:1788725897.178037:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418560 00000100:00100000:3.0:1788725897.178153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788725897.178169:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+11:10494:x1875614770418560:12345-192.168.203.12@tcp:36:chown.0 00010000:00010000:3.0:1788725897.178255:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725897.178341:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d36feb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d5c expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.178364:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:3.0:1788725897.178370:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725897.178539:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.178553:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.178624:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788725897.185058:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788725897.185361:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033cc12a7 reply state 0000000014439d21 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.185426:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.185437:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:3.0:1788725897.185441:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788725897.185447:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788725897.185465:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788725897.185607:0:6512:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788725897.185638:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:10494:x1875614770418560:12345-192.168.203.12@tcp:36:chown.0 Request processed in 7460us (7715us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788725897.185649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:2.0:1788725897.185925:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.185936:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.185954:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.185960:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725897.185965:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.185975:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.185989:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:2.0:1788725897.185991:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788725897.185996:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.186002:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d36ff2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188337:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188359:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188369:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188375:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.188381:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188389:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188409:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283236300) 00010000:00010000:1.0:1788725897.188413:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.188417:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188424:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d36fa5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188468:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188493:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188499:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188505:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.188508:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188514:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188523:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:1.0:1788725897.188525:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.188528:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188533:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d36fac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188549:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188556:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188563:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188569:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.188578:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188585:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188594:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:1.0:1788725897.188596:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788725897.188599:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.188605:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d36fc1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725897.222516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725897.222946:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418688 00000100:00100000:0.0:1788725897.222959:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418688 00000100:00100000:0.0:1788725897.223028:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788725897.223039:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:10495:x1875614770418688:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:0.0:1788725897.223069:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725897.223093:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d36ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d63 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788725897.236582:0:9522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8580us 00010000:00010000:2.0:1788725897.266507:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266538:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266552:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266569:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266589:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266597:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266793:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266803:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266811:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725897.266851:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788725897.266855:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725897.266905:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266921:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266929:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266936:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266942:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725897.266947:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266963:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266980:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:2.0:1788725897.266984:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725897.266990:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.266996:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658400/0xa13c582691d37000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267009:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267015:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267022:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267026:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725897.267029:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267035:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267043:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283455d00) 00010000:00010000:2.0:1788725897.267046:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725897.267049:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267066:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37007 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267148:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d36ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d63 expref: 8 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267165:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d63 expref: 7 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.267174:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:2.0:1788725897.267176:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788725897.267179:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658c00, rc 0) 00000100:00100000:2.0:1788725897.267285:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:10495:x1875614770418688:12345-192.168.203.12@tcp:101:touch.500 Request processed in 44245us (44780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.267295:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788725897.271708:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.271771:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770418944 00000100:00100000:2.0:1788725897.271795:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770418944 00000100:00100000:2.0:1788725897.271873:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788725897.271895:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:10495:x1875614770418944:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1788725897.271924:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725897.271950:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37015 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d6a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272097:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272144:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272172:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272317:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272341:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272358:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788725897.272793:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788725897.272945:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3702a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272955:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3702a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272963:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3702a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.272997:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273004:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273010:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273014:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725897.273025:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273032:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273043:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:2.0:1788725897.273046:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725897.273050:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273055:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3701c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725897.273072:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecabdd90 reply state 00000000948ecdb5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273083:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273089:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff9b1283455500) 00010000:00010000:2.0:1788725897.273091:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725897.273094:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788725897.273511:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37015 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d6a expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273530:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3702a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d6a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.273537:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:2.0:1788725897.273539:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725897.273548:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658800, rc 0) 00000100:00100000:2.0:1788725897.273620:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+10:10495:x1875614770418944:12345-192.168.203.12@tcp:101:touch.500 Request processed in 1737us (1929us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788725897.273629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788725897.282188:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725897.282355:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419200 00000100:00100000:3.0:1788725897.282368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419200 00000100:00100000:3.0:1788725897.282454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788725897.282469:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+10:10495:x1875614770419200:12345-192.168.203.12@tcp:36:touch.500 00010000:00010000:3.0:1788725897.282553:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725897.282601:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3702a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d6a expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.282624:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:3.0:1788725897.282637:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725897.282716:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.282733:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.282744:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788725897.282910:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab999c82 reply state 000000004772aa9a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.282924:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.282931:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:3.0:1788725897.282934:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788725897.282937:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788725897.283061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+11:10495:x1875614770419200:12345-192.168.203.12@tcp:36:touch.500 Request processed in 595us (888us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788725897.283069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788725897.294904:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.295001:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419328 00000100:00100000:2.0:1788725897.295016:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419328 00000100:00100000:2.0:1788725897.295173:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:2.0:1788725897.295186:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+11:10495:x1875614770419328:12345-192.168.203.12@tcp:101:touch.500 00010000:00010000:2.0:1788725897.295220:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725897.295247:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d3703f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d71 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.295323:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d3703f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d71 expref: 12 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.295339:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d3703f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d71 expref: 12 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.295360:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:2.0:1788725897.295364:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788725897.295368:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659600, rc 0) 00000100:00100000:2.0:1788725897.295457:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+12:10495:x1875614770419328:12345-192.168.203.12@tcp:101:touch.500 Request processed in 273us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.295464:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788725897.304090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.305742:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419456 00000100:00100000:2.0:1788725897.305754:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419456 00000100:00100000:2.0:1788725897.305819:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788725897.305828:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770419456:12345-192.168.203.12@tcp:8:touch.500 00010000:00080000:2.0:1788725897.305875:0:8716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:2.0:1788725897.306108:0:8716:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d37046 00002000:00100000:2.0:1788725897.306188:0:8716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78ae299a-14d0-4856-aa24-442bf24804dd/ffff9b139f7cf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725897.306206:0:8716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725897.306469:0:8716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725897.306500:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b139f7cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725897.306570:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770419456:12345-192.168.203.12@tcp:8:touch.500 Request processed in 741us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.306578:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788725897.312951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.313679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419584 00000100:00100000:2.0:1788725897.313693:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419584 00000100:00080000:0.0:1788725897.313771:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725897.313814:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788725897.313824:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:0:x1875614770419584:12345-192.168.203.12@tcp:2:touch.500 00000001:00080000:3.0:1788725897.328684:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788725897.328706:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000100:00100000:2.0:1788725897.328993:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:0:x1875614770419584:12345-192.168.203.12@tcp:2:touch.500 Request processed in 15160us (16047us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788725897.329006:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788725897.334785:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.334890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419840 00000100:00100000:2.0:1788725897.334907:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419840 00000100:00100000:2.0:1788725897.335054:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788725897.335068:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+12:10495:x1875614770419840:12345-192.168.203.12@tcp:35:touch.500 00000100:00100000:2.0:1788725897.335667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+13:10495:x1875614770419840:12345-192.168.203.12@tcp:35:touch.500 Request processed in 599us (897us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788725897.335678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788725897.339978:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725897.340005:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791472896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725897.340076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.341770:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791472896 00000100:00100000:2.0:1788725897.341821:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791472896 00000100:00100000:2.0:1788725897.341935:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788725897.341952:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791472896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725897.342001:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725897.342108:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791472896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.342150:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788725897.342376:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af860700 x1875614791472896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725897.342402:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791472896:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788725897.342477:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725897.342674:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791473024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725897.342731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725897.342851:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473024 00000100:00100000:2.0:1788725897.342858:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473024 00000100:00100000:2.0:1788725897.343046:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788725897.343057:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791473024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725897.343075:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725897.343167:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791473024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.343177:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788725897.343334:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af861500 x1875614791473024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725897.343354:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791473024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725897.345214:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725897.363592:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.363785:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770419968 00000100:00100000:2.0:1788725897.363798:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770419968 00000100:00100000:2.0:1788725897.363872:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788725897.363885:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:10496:x1875614770419968:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:2.0:1788725897.363919:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725897.363945:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3704d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d78 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364036:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364052:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364090:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725897.364193:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788725897.364197:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725897.364259:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364294:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3704d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d78 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364619:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d78 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725897.364631:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:2.0:1788725897.364634:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788725897.364638:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659800, rc 0) 00000100:00100000:2.0:1788725897.364748:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+14:10496:x1875614770419968:12345-192.168.203.12@tcp:101:rm.0 Request processed in 864us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725897.364757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788725897.370002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725897.370096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770420224 00000100:00100000:3.0:1788725897.370110:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770420224 00000100:00100000:3.0:1788725897.370209:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788725897.370221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:10496:x1875614770420224:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:3.0:1788725897.370251:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725897.370279:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d3705b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d7f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725897.370574:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788725897.370797:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d3705b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d7f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.370829:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:3.0:1788725897.370833:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788725897.370840:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044200/0xa13c582691d3705b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d7f expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725897.370862:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044200, rc 0) 00000100:00100000:3.0:1788725897.370949:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+15:10496:x1875614770420224:12345-192.168.203.12@tcp:101:rm.0 Request processed in 730us (963us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788725897.370957:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1788725897.380070:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725897.380222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770420352 00000100:00100000:3.0:1788725897.380236:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770420352 00000100:00100000:3.0:1788725897.380435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788725897.380450:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:10496:x1875614770420352:12345-192.168.203.12@tcp:37:rm.0 00000100:00100000:3.0:1788725897.394166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:10496:x1875614770420352:12345-192.168.203.12@tcp:37:rm.0 Request processed in 13704us (14096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725897.394182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:0.0:1788725897.399029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.399157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770420608 00000100:00100000:2.0:1788725897.399172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770420608 00000100:00100000:2.0:1788725897.399251:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788725897.399264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+15:10496:x1875614770420608:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1788725897.399575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+16:10496:x1875614770420608:12345-192.168.203.12@tcp:35:rm.0 Request processed in 313us (562us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788725897.399584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788725897.405954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.406000:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.406056:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.406098:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.406211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.406245:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770420992 00000100:00100000:1.0:1788725897.406259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770420992 00000100:00100000:1.0:1788725897.406401:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 332 00000100:00100000:1.0:1788725897.406414:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770420992:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725897.406507:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770420992:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.406515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 332 00000100:00100000:1.0:1788725897.406723:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770420864 00000100:00100000:1.0:1788725897.406728:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770420864 00000100:00100000:1.0:1788725897.406757:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421120 00000100:00100000:1.0:1788725897.406760:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421120 00000100:00100000:1.0:1788725897.406802:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421376 00000100:00100000:1.0:1788725897.406805:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421376 00000100:00100000:1.0:1788725897.406820:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421248 00000100:00100000:1.0:1788725897.406822:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421248 00000100:00100000:1.0:1788725897.406838:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:1.0:1788725897.406845:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770421120:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725897.406885:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770421120:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.406892:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:1.0:1788725897.406906:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1788725897.406913:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770421376:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725897.406942:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770421376:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.406962:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1788725897.406976:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1788725897.406982:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770421248:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725897.407008:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770421248:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.407014:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:1.0:1788725897.407026:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788725897.407031:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+16:10496:x1875614770420864:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1788725897.407048:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725897.407080:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d86 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.407251:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37070 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.407269:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37070 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.407283:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37070 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725897.407295:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000100:00080000:0.0:1788725897.407450:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725897.407456:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788725897.409240:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d86 expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.409277:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37070 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d86 expref: 18 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.409621:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:1.0:1788725897.409626:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725897.409632:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b600, rc 0) 00000100:00100000:1.0:1788725897.409735:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770420864:12345-192.168.203.12@tcp:101:rm.0 Request processed in 2700us (3794us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788725897.409746:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788725897.413023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725897.413178:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421504 00000100:00100000:0.0:1788725897.413191:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421504 00000100:00100000:0.0:1788725897.413256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788725897.413271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770421504:12345-192.168.203.12@tcp:41:rm.0 00000004:00000024:0.0:1788725897.413357:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788725897.413454:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770421504:12345-192.168.203.12@tcp:41:rm.0 Request processed in 186us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725897.413462:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788725897.416381:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.417695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421632 00000100:00100000:1.0:1788725897.417716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421632 00000100:00100000:1.0:1788725897.418077:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788725897.418094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770421632:12345-192.168.203.12@tcp:101:rm.0 00010000:00010000:1.0:1788725897.418172:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725897.418201:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d3707e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d8d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418293:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418838:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418857:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418875:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418885:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.418910:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419072:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419084:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419090:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725897.419180:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788725897.419185:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725897.419210:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419224:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419234:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419240:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419247:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419253:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.419258:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419274:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419289:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:1.0:1788725897.419292:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.419297:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.419302:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421528:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421561:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421571:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421577:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fe00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.421582:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421591:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421612:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff9b1283455500) 00010000:00010000:1.0:1788725897.421616:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.421621:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d3708c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421720:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d3707e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d8d expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421736:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d8d expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.421744:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:1.0:1788725897.421747:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788725897.421750:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:1.0:1788725897.421844:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+19:10496:x1875614770421632:12345-192.168.203.12@tcp:101:rm.0 Request processed in 3753us (5472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725897.421854:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788725897.429830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725897.429915:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770421888 00000100:00100000:0.0:1788725897.429927:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770421888 00000100:00100000:0.0:1788725897.429998:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788725897.430009:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:10496:x1875614770421888:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:0.0:1788725897.430077:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788725897.430110:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37093 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d8d expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430188:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d3703f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d71 expref: 18 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430204:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:0.0:1788725897.430215:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659800/0xa13c582691d37054 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d78 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430224:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:0.0:1788725897.430228:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725897.430256:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430271:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430281:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430294:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430302:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430476:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430596:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430960:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.430970:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788725897.432033:0:11950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788725897.432052:0:11950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342587934074ns, next at 343587930199ns, rc = 0 00010000:00010000:0.0:1788725897.432153:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432169:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432181:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432189:0:11950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432197:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432203:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432237:0:11950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788725897.432264:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432271:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432294:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432300:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725897.432305:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432323:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432338:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:0.0:1788725897.432342:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788725897.432347:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432354:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d370a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432376:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432383:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432388:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432393:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725897.432395:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432411:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432420:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:0.0:1788725897.432422:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725897.432426:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432432:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d3709a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725897.432444:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f8cdf18 reply state 00000000873e51c6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432455:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725897.432462:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff9b1283455500) 00010000:00010000:0.0:1788725897.432464:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788725897.432467:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788725897.432594:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770421888:12345-192.168.203.12@tcp:36:rm.0 Request processed in 2580us (2771us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788725897.432616:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00010000:00010000:1.0:1788725897.437388:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725897.437405:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.437419:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788725897.437424:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.437436:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.437460:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:1.0:1788725897.437486:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788725897.437493:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.437499:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d370af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.437522:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725897.437524:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725897.437526:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725897.442428:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725897.442638:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422144 00000100:00100000:2.0:1788725897.442652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422144 00000100:00100000:2.0:1788725897.442729:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788725897.442741:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770422144:12345-192.168.203.12@tcp:35:rm.0 00000100:00100000:2.0:1788725897.443051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+19:10496:x1875614770422144:12345-192.168.203.12@tcp:35:rm.0 Request processed in 311us (637us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788725897.443060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788725897.452317:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725897.452436:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422400 00000100:00100000:1.0:1788725897.452450:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422400 00000100:00100000:1.0:1788725897.452526:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788725897.452538:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:10496:x1875614770422400:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788725897.452624:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788725897.452660:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37070 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d86 expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452687:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658c00/0xa13c582691d3700e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d63 expref: 18 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452700:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283455300) 00010000:00010000:1.0:1788725897.452717:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d36fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d55 expref: 17 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452725:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1394485d00) 00010000:00010000:1.0:1788725897.452734:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725897.452763:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452809:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452819:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452833:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452840:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452846:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452941:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452949:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.452955:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725897.453308:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788725897.453325:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453333:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453340:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453353:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.453359:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453367:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453379:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9b1283236500) 00010000:00010000:1.0:1788725897.453381:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788725897.453385:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453390:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d370c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453412:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453418:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453425:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453429:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725897.453432:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453438:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453455:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283236800) 00010000:00010000:1.0:1788725897.453458:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725897.453461:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453466:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d370b6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725897.453480:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ce3c9a4 reply state 0000000076284978 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453492:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725897.453498:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283236300) 00010000:00010000:1.0:1788725897.453500:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725897.453503:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788725897.453594:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:10496:x1875614770422400:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1054us (1299us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788725897.453601:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00010000:00010000:1.0:1788725898.107979:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725899.131650:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725899.389110:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791473152:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.389207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.392417:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791473664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725899.392481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.392515:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725899.392522:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791473536:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.393087:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473152 00000100:00100000:1.0:1788725899.393095:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473152 00000100:00100000:1.0:1788725899.393229:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788725899.393240:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791473152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393356:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791473152:12345-0@lo:400:kworker.0 Request processed in 54us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725899.393365:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788725899.393404:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791473280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.393451:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725899.393457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791473408:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.393519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473536 00000100:00100000:1.0:1788725899.393524:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473536 00000100:00100000:1.0:1788725899.393686:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473280 00000100:00100000:1.0:1788725899.393691:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473280 00000100:00100000:1.0:1788725899.393712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788725899.393718:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791473536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393751:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791473536:12345-0@lo:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725899.393757:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788725899.393781:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788725899.393787:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791473280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393816:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791473280:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725899.393832:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788725899.393876:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791473280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393912:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791473536:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.393922:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791473152:0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.394072:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473408 00000100:00100000:3.0:1788725899.394078:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473408 00000100:00100000:2.0:1788725899.394110:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473664 00000100:00100000:3.0:1788725899.394129:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725899.394134:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473664 00000100:00100000:3.0:1788725899.394140:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791473408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394177:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788725899.394186:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791473664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725899.394209:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725899.394249:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791473664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.394256:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788725899.394281:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788725899.394369:0:9813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344550250979ns, next at 345550248596ns, rc = 0 00000100:00100000:2.0:1788725899.394491:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791474048:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725899.394564:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725899.394570:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791474176:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394590:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725899.394647:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791474560:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.394715:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791473792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725899.394718:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725899.394746:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791474688:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.394748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.394779:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791474304:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.394812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725899.394844:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474816:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394864:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474048 00000100:00100000:1.0:1788725899.394870:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725899.394871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474048 00000100:00100000:1.0:1788725899.394892:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788725899.394900:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791473920:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.394910:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474176 00000100:00100000:1.0:1788725899.394924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725899.394928:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474176 00000100:00100000:2.0:1788725899.394947:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474560 00000100:00100000:2.0:1788725899.394950:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474560 00000100:00100000:2.0:1788725899.394961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474688 00000100:00100000:2.0:1788725899.394962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474688 00000100:00100000:2.0:1788725899.394974:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788725899.394981:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791474048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791474048:12345-0@lo:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.395031:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788725899.395047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788725899.395053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791474176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395085:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791474176:12345-0@lo:400:kworker.0 Request processed in 33us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.395090:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788725899.395101:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788725899.395107:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395169:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791474560:12345-0@lo:400:kworker.0 Request processed in 62us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.395176:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788725899.395188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788725899.395193:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791474688:12345-0@lo:400:kworker.0 Request processed in 37us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.395238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788725899.395261:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473920 00000100:00100000:2.0:1788725899.395265:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473920 00000100:00100000:2.0:1788725899.395284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788725899.395290:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791473920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395320:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791473920:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.395325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788725899.395353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725899.395356:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725899.395376:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791473408:12345-0@lo:400:kworker.0 Request processed in 1238us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725899.395384:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1788725899.395394:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138422ce00 x1875614791474688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725899.395406:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791474688:0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.395410:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791473792 00000100:00100000:2.0:1788725899.395419:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791474560:0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.395421:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791473792 00010000:00080000:2.0:1788725899.395432:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138767fb80 x1875614791474176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725899.395441:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791474176:0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.395453:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791474048:0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.395466:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788725899.395475:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791473792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725899.395488:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788725899.395489:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725899.395518:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791473792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725899.395524:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788725899.395879:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474432:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.395908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788725899.395933:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be826680 x1875614791473792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725899.396002:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474304 00000100:00100000:2.0:1788725899.396007:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474304 00000100:00100000:2.0:1788725899.396038:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474816 00000100:00100000:2.0:1788725899.396041:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474816 00000100:00100000:3.0:1788725899.396058:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474432 00000100:00100000:3.0:1788725899.396064:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474432 00000100:00100000:2.0:1788725899.396067:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788725899.396077:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791474304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.396095:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788725899.396104:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725899.396135:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791474304:12345-0@lo:400:kworker.0 Request processed in 40us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.396142:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788725899.396154:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788725899.396160:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.396257:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791473792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725899.397005:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474432:12345-0@lo:400:kworker.0 Request processed in 841us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725899.397018:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788725899.397044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788725899.397884:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be824380 x1875614791473664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725899.397906:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791473664:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788725899.398848:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82a300 x1875614791474304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725899.398861:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791474304:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.398874:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791473408:0@lo:400:kworker.0 00000100:00100000:1.0:1788725899.398914:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791473920:0@lo:400:kworker.0 00010000:00080000:1.0:1788725899.398926:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be829180 x1875614791474432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725899.398934:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474432:0@lo:400:kworker.0 00000100:00100000:3.0:1788725899.400348:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474816:12345-0@lo:400:kworker.0 Request processed in 4234us (5468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725899.400362:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788725899.404408:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138422d500 x1875614791474816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725899.404433:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474816:0@lo:400:kworker.0 00010000:00010000:0.0:1788725900.157347:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725900.415166:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725900.419666:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725900.419742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725900.425986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791474944 00000100:00100000:0.0:1788725900.426000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791474944 00000100:00100000:0.0:1788725900.426063:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788725900.426073:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725900.426111:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725900.426212:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791474944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (6469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725900.426219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788725900.426418:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791474944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788725901.184437:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788725901.521278:0:13673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788725901.948038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791475072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725901.948109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725901.948822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475072 00000100:00100000:1.0:1788725901.948831:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475072 00000100:00100000:1.0:1788725901.948884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788725901.948894:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791475072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725901.948926:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725901.948981:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791475072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725901.948988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788725901.949411:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791475072:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725902.203391:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725902.460285:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791475200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725902.460350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725902.460422:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475200 00000100:00100000:1.0:1788725902.460429:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475200 00000100:00100000:1.0:1788725902.460476:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788725902.460487:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791475200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725902.460513:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725902.460556:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791475200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725902.460562:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788725902.460591:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725902.460620:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af860700 x1875614791475200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725902.460649:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791475200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725902.460766:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725902.460776:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791475328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725902.460814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725902.460841:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475328 00000100:00100000:3.0:1788725902.460844:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475328 00000100:00100000:3.0:1788725902.460873:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788725902.460880:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791475328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725902.460890:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725902.460919:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791475328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725902.460925:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788725902.460945:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788725902.460961:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635880 x1875614791475328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725902.460974:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791475328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725902.526671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725902.526760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725902.526772:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422656 00000100:00100000:2.0:1788725902.526789:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422656 00000100:00100000:1.0:1788725902.526807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725902.526865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725902.526880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423168 00000100:00100000:2.0:1788725902.526885:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423168 00000100:00100000:1.0:1788725902.526906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725902.526923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422784 00000100:00100000:2.0:1788725902.526930:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422784 00000100:00100000:1.0:1788725902.526952:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725902.526968:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423040 00000100:00100000:2.0:1788725902.526975:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423040 00000100:00100000:1.0:1788725902.527005:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422528 00000100:00100000:2.0:1788725902.527006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1788725902.527018:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422528 00000100:00100000:2.0:1788725902.527027:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+18:2395:x1875614770422656:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725902.527082:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 334 00000100:00100000:1.0:1788725902.527096:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770422528:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725902.527193:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+18:2395:x1875614770422656:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 170us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.527205:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:1.0:1788725902.527206:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770422528:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725902.527220:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 334 00000100:00100000:2.0:1788725902.527240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1788725902.527253:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770423168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725902.527277:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1788725902.527291:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770422784:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725902.527300:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770423168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.527310:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:2.0:1788725902.527332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:1.0:1788725902.527344:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770422784:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.527347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770423040:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725902.527366:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1788725902.527401:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770423040:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 56us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.527410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00080000:0.0:1788725902.527640:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725902.527646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725902.528469:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770422912 00000100:00100000:3.0:1788725902.528482:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770422912 00000100:00080000:0.0:1788725902.528552:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725902.528580:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788725902.528852:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770422912:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725902.528940:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770422912:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 95us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725902.528947:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000020:00000080:0.0:1788725902.882360:0:13721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcab5c720 20000000:00000080:0.0:1788725902.882384:0:13721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b139e58ac00 uarg=0000000000000000 20000000:01000000:0.0:1788725902.882437:0:13721:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788725902.882445:0:13721:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788725902.882450:0:13721:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788725902.884689:0:13722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788725902.885841:0:13721:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788725902.893279:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788725902.893344:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788725902.893359:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788725902.893380:0:13721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788725902.893404:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893427:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f58 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893436:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893444:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893451:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d36f82 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893479:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893487:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893494:0:13721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893541:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.893557:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 12 pid: 6504 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.893574:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475456:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725902.894298:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.894311:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.894324:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475584:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725902.894392:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.894401:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.894425:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475712:0@lo:104: 00000100:00100000:3.0:1788725902.894476:0:13721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725902.894509:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.894519:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.894528:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475840:0@lo:104: 00010000:00010000:3.0:1788725902.894557:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725902.894559:0:10329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788725902.894570:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.894581:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475968:0@lo:104: 00000100:00100000:1.0:1788725902.894612:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725902.894653:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475712 00000100:00100000:1.0:1788725902.894662:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475712 00000100:00100000:1.0:1788725902.894728:0:10329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475840 00000100:00100000:1.0:1788725902.894732:0:10329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475840 00000100:00100000:1.0:1788725902.894761:0:10329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788725902.894770:0:10329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13721:x1875614791475712:12345-0@lo:104: 00000100:00100000:0.0:1788725902.894771:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788725902.894781:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13721:x1875614791475840:12345-0@lo:104: 00010000:00010000:1.0:1788725902.894788:0:10329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.894788:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.894876:0:10329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788725902.894884:0:10329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13721:x1875614791475712:12345-0@lo:104: Request processed in 115us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725902.894892:0:10329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1788725902.894904:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788725902.894909:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13721:x1875614791475840:12345-0@lo:104: Request processed in 131us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725902.894919:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788725902.894937:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788725902.894943:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.894946:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725902.894950:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.894951:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725902.894956:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.894957:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788725902.894960:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.894965:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.894965:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788725902.894973:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725902.894973:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788725902.894980:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788725902.894980:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788725902.895073:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.895079:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725902.895105:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.895112:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383659200/0xa13c582691d36f82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f89 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895153:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895159:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725902.895159:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725902.895161:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725902.895163:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725902.895178:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791476224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725902.895180:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895187:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383658600/0xa13c582691d36f74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895196:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725902.895198:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725902.895200:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725902.895210:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791476096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725902.895214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725902.895239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725902.895251:0:13721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725902.895284:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476224 00000100:00100000:0.0:1788725902.895288:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476096 00000100:00100000:1.0:1788725902.895289:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476224 00000100:00100000:0.0:1788725902.895291:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476096 00010000:00010000:3.0:1788725902.895311:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 25 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895316:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.895316:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.895336:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.895352:0:13721:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791476352:0@lo:104: 00000100:00100000:1.0:1788725902.895354:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788725902.895371:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+25:3641:x1875614791476224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725902.895382:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725902.895388:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895401:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.895405:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791475968 00000100:00100000:3.0:1788725902.895408:0:13721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725902.895411:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791475968 00010000:00010000:1.0:1788725902.895429:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725902.895435:0:13721:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725902.895448:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476352 00000100:00100000:2.0:1788725902.895453:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476352 00010000:00010000:3.0:1788725902.895470:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383658e00/0xa13c582691d36f89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36f82 expref: 25 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.895471:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725902.895471:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+25:3641:x1875614791476224:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.895489:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13721:x1875614791475968:12345-0@lo:104: 00000100:00100000:1.0:1788725902.895498:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1788725902.895510:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725902.895513:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788725902.895536:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791476096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725902.895549:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788725902.895555:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475712:0@lo:104: 00010000:00010000:1.0:1788725902.895557:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725902.895576:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.895587:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788725902.895587:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725902.895593:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659e00/0xa13c582691d36f7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36f74 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.895600:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+4:13721:x1875614791475968:12345-0@lo:104: Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725902.895614:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475840:0@lo:104: 00000100:00100000:1.0:1788725902.895620:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3638:x1875614791476096:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.895634:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788725902.895635:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788725902.895649:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788725902.895655:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13721:x1875614791476352:12345-0@lo:104: 00010000:00010000:2.0:1788725902.895662:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.896244:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475968:0@lo:104: 00000100:00100000:1.0:1788725902.896858:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791476096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788725902.896883:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788725902.896890:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+3:13721:x1875614791476352:12345-0@lo:104: Request processed in 1235us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.896897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788725902.896914:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788725902.896919:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.896925:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1380031000 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725902.896928:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.896936:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725902.896943:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725902.896948:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788725902.896972:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.896978:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788725902.896999:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897006:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1380031000/0xa13c582691d36f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f6d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897017:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788725902.897021:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897027:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afe00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788725902.897030:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897036:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788725902.897042:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725902.897047:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788725902.897049:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725902.897060:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897065:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788725902.897094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791476224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725902.897107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791476608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725902.897155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725902.897170:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791476480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725902.897193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725902.897214:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.897219:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476608 00010000:00010000:2.0:1788725902.897221:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6afe00/0xa13c582691d36f58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d36f5f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.897222:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476608 00010000:00010000:2.0:1788725902.897233:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725902.897240:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725902.897241:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 22 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897242:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725902.897258:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476480 00000100:00100000:0.0:1788725902.897261:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476480 00010000:00010000:0.0:1788725902.897272:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.897294:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788725902.897302:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3640:x1875614791476608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788725902.897310:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725902.897314:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.897323:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.897324:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788725902.897331:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3639:x1875614791476480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788725902.897335:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725902.897339:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725902.897343:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897351:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.897430:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148ba00/0xa13c582691d36f5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36f58 expref: 23 pid: 6504 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725902.897444:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791476352:0@lo:104: 00010000:00010000:2.0:1788725902.897469:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6afc00/0xa13c582691d36f6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d36f66 expref: 23 pid: 6505 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.897479:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725902.897510:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3639:x1875614791476480:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.897516:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788725902.897610:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791476480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725902.897803:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791476608:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725902.897809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788725902.897892:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791476608:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1788725902.898338:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788725902.898387:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788725902.898395:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788725902.898494:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791476736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788725902.898524:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898532:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898539:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.898540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725902.898544:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725902.898549:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898612:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898628:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff9b1283455500) 00010000:00010000:3.0:1788725902.898637:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725902.898641:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898647:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659c00/0xa13c582691d37023 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.898647:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476736 00000100:00100000:2.0:1788725902.898651:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476736 00010000:00010000:3.0:1788725902.898665:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898672:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898677:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898682:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725902.898685:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898691:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898700:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9b1383ca0400) 00010000:00010000:3.0:1788725902.898702:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725902.898705:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898711:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37038 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898728:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.898731:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788725902.898752:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791476736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788725902.898756:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898761:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898765:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afa00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725902.898768:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898773:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788725902.898774:0:8716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1788725902.898782:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x62d23e39 (ffff9b1283455500) 00010000:00010000:3.0:1788725902.898784:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725902.898786:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898791:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d370a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x62d23e39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788725902.898800:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9dca88, atime: 0x6a9dca88, ctime: 0x6a9dca88, blocks: 0x0 00010000:00010000:3.0:1788725902.898805:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898807:0:8716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898811:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898817:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898820:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725902.898820:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1788725902.898824:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725902.898828:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898833:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898835:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898841:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b1283236300) 00010000:00010000:3.0:1788725902.898843:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725902.898846:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898850:0:8716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898851:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d370bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898859:0:8716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898866:0:8716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.898884:0:8716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788725902.898907:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725902.898912:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898919:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725902.898922:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898929:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898941:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898948:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4d6d94a/0xa13c582691d370d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.898967:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725902.898969:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725902.898971:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725902.899019:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791476736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 265us (474us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788725902.899026:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788725902.899081:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b138422c700/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788725902.899087:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791476736:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788725902.899261:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725902.902478:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725902.902630:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475456:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725902.902643:0:13721:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875614791475584:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725902.902722:0:13721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.902874:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423296 00000100:00100000:0.0:1788725902.902882:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423296 00010000:00010000:0.0:1788725902.902927:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725902.902963:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788725902.902972:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770423296:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725902.902985:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725902.902991:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.903002:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.903018:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380031a00/0xa13c582691d36f97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d47 expref: 13 pid: 6504 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725902.903033:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725902.903088:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:2396:x1875614770423296:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 115us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725902.903095:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:0.0:1788725902.909670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725902.909801:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423424 00000100:00100000:2.0:1788725902.909812:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423424 00010000:00010000:2.0:1788725902.909850:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.909890:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:2.0:1788725902.909900:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+12:2395:x1875614770423424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725902.909914:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725902.909920:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.909952:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.909972:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148a800/0xa13c582691d36f90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d40 expref: 12 pid: 6506 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.909987:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.909995:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910010:0:10330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910016:0:10330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910023:0:10330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910030:0:10330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910036:0:10330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788725902.910041:0:10330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910052:0:10330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910082:0:10330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725902.910092:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725902.910185:0:13721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.910205:0:13721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725902.910212:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2044200/0xa13c582691d370cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725902.910276:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+11:2395:x1875614770423424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 374us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725902.910286:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00010000:00010000:1.0:1788725903.229635:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788725903.811441:0:13771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf04b5980 20000000:00000080:1.0:1788725903.811464:0:13771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b1283c54800 uarg=0000000000000000 20000000:01000000:1.0:1788725903.811524:0:13771:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788725903.811532:0:13771:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788725903.811539:0:13771:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788725903.812549:0:13772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788725903.812745:0:13771:0:(mgs_llog.c:4123:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788725903.812864:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788725903.812896:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788725903.812906:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788725903.812918:0:13771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788725903.812945:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.812965:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.812985:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.812993:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813000:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813008:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813015:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725903.813020:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813029:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813045:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813053:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725903.813061:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2044200/0xa13c582691d370d9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.251480:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725904.507690:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725904.507801:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791476864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725904.507925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.508097:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791476992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725904.508156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.508188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791477248:0@lo:400:kworker.0 00000100:00100000:3.0:1788725904.508189:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791477504:0@lo:400:kworker.0 00000100:00100000:3.0:1788725904.508225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.508258:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476864 00000100:00100000:0.0:1788725904.508269:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476864 00000100:00100000:1.0:1788725904.508290:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791477376:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.508348:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791476992 00000100:00100000:0.0:1788725904.508352:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791476992 00000100:00100000:2.0:1788725904.508356:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788725904.508374:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791476864:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725904.508376:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788725904.508388:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791476992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725904.508417:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788725904.508417:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725904.509885:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.509940:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791477888:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.509969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.509988:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791478400:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.510032:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725904.510037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791478528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.510095:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791477120:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.510185:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791477632:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.510233:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791478144:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.510252:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791476992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1862us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725904.510269:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788725904.510270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788725904.510313:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725904.510317:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477504 00000100:00100000:1.0:1788725904.510326:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477504 00000100:00100000:0.0:1788725904.510334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.510368:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791477760:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.510395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.510408:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791478272:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.510432:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.510460:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477888 00000100:00100000:0.0:1788725904.510464:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477888 00000100:00100000:0.0:1788725904.510491:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478400 00000100:00100000:0.0:1788725904.510494:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478400 00000100:00100000:0.0:1788725904.510506:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477248 00000100:00100000:0.0:1788725904.510509:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477248 00000100:00100000:0.0:1788725904.510519:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477760 00000100:00100000:0.0:1788725904.510521:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477760 00000100:00100000:0.0:1788725904.510532:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478272 00000100:00100000:0.0:1788725904.510534:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478272 00000100:00100000:0.0:1788725904.510552:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788725904.510559:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.510610:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791477504:12345-0@lo:400:kworker.0 Request processed in 51us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510652:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788725904.510661:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791477888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510703:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791477888:12345-0@lo:400:kworker.0 Request processed in 44us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510710:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788725904.510740:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788725904.510747:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791478400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510771:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791478400:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510784:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788725904.510795:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788725904.510800:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791477248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510828:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791477248:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510834:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788725904.510843:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788725904.510848:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791477760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510868:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791477760:12345-0@lo:400:kworker.0 Request processed in 21us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510874:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788725904.510882:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788725904.510888:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791478272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.510908:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791478272:12345-0@lo:400:kworker.0 Request processed in 20us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.510913:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788725904.510933:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478528 00000100:00100000:1.0:1788725904.510936:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478528 00000100:00100000:1.0:1788725904.510959:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478144 00000100:00100000:1.0:1788725904.510961:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478144 00000100:00100000:1.0:1788725904.510981:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725904.510987:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791478528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511013:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791478528:12345-0@lo:400:kworker.0 Request processed in 26us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.511018:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725904.511035:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725904.511041:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791478144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511067:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791478144:12345-0@lo:400:kworker.0 Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.511073:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788725904.511087:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477120 00000100:00100000:1.0:1788725904.511093:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477120 00000100:00100000:0.0:1788725904.511098:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1788725904.511152:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725904.511157:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725904.511159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725904.511204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477376 00000100:00100000:0.0:1788725904.511208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477376 00000100:00100000:0.0:1788725904.511240:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791477632 00000100:00100000:0.0:1788725904.511244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791477632 00000100:00100000:0.0:1788725904.511260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788725904.511266:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791477376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511303:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788725904.511310:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791477376:12345-0@lo:400:kworker.0 Request processed in 42us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.511314:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791477120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.511324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788725904.511342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788725904.511352:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791477632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511358:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3640:x1875614791477120:12345-0@lo:400:kworker.0 Request processed in 48us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.511366:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788725904.511390:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791477632:12345-0@lo:400:kworker.0 Request processed in 40us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725904.511397:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788725904.511443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791478528:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.511460:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791477376:0@lo:400:kworker.0 00010000:00080000:0.0:1788725904.511479:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bed80 x1875614791477888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725904.511489:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791477248:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.511494:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791477888:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511506:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791477760:0@lo:400:kworker.0 00010000:00080000:0.0:1788725904.511517:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bca80 x1875614791478400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725904.511542:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791478400:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.511593:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791477120:0@lo:400:kworker.0 00000100:00100000:0.0:1788725904.511606:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791477632:0@lo:400:kworker.0 00010000:00080000:0.0:1788725904.511616:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bc000 x1875614791478144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725904.511625:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791478144:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.511659:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791478272:0@lo:400:kworker.0 00000100:00100000:2.0:1788725904.513221:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791476864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4838us (5283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.513237:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788725904.513399:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791477504:0@lo:400:kworker.0 00000100:00100000:3.0:1788725904.513415:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791478016:0@lo:400:kworker.0 00000100:00100000:3.0:1788725904.513459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.513522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791476864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725904.513564:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791476992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725904.513921:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478016 00000100:00100000:1.0:1788725904.513930:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478016 00000100:00080000:0.0:1788725904.514935:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725904.515715:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788725904.515755:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791478016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.515879:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791478016:12345-0@lo:400:kworker.0 Request processed in 151us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.515887:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788725904.515992:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bdc00 x1875614791478016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725904.516024:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791478016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725904.768861:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.771961:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423552 00000100:00100000:2.0:1788725904.771984:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423552 00000100:00100000:2.0:1788725904.772197:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 336 00000100:00100000:2.0:1788725904.772212:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+11:6168:x1875614770423552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725904.772239:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725904.772268:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383658000/0xa13c582691d370e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d94 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.772309:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383658000/0xa13c582691d370e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d94 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.772323:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383658000/0xa13c582691d370e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d94 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.772355:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658000, rc 0) 00000100:00100000:2.0:1788725904.772450:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770423552:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 241us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.772458:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 336 00000100:00100000:1.0:1788725904.777260:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.782009:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423680 00000100:00100000:2.0:1788725904.782032:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423680 00000100:00100000:2.0:1788725904.782171:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 337 00000100:00100000:2.0:1788725904.782232:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770423680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.782445:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770423680:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 215us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.782453:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 337 00000100:00100000:0.0:1788725904.790289:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.790544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423808 00000100:00100000:2.0:1788725904.790557:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423808 00000100:00100000:2.0:1788725904.790631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 338 00000100:00100000:2.0:1788725904.790645:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770423808:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.790860:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770423808:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 217us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.790869:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 338 00000100:00100000:1.0:1788725904.805550:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.805753:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770423936 00000100:00100000:2.0:1788725904.805766:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770423936 00000100:00100000:2.0:1788725904.805839:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 339 00000100:00100000:2.0:1788725904.805852:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:10780:x1875614770423936:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725904.806063:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+12:10780:x1875614770423936:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 213us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.806082:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 339 00000100:00100000:3.0:1788725904.811613:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725904.811805:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424064 00000100:00100000:1.0:1788725904.811818:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424064 00000100:00100000:1.0:1788725904.811891:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 340 00000100:00100000:1.0:1788725904.811901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+12:10780:x1875614770424064:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788725904.812086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+12:10780:x1875614770424064:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 186us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.812095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 340 00000100:00100000:0.0:1788725904.817933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725904.818774:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424192 00000100:00100000:1.0:1788725904.818790:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424192 00000100:00100000:1.0:1788725904.818872:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 341 00000100:00100000:1.0:1788725904.818884:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+12:6168:x1875614770424192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725904.818904:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725904.818927:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e800/0xa13c582691d370e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6d9b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.818961:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e800/0xa13c582691d370e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d9b expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.818974:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e800/0xa13c582691d370e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d9b expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.818985:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e800, rc 0) 00000100:00100000:1.0:1788725904.819109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770424192:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 227us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.819154:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 341 00000100:00100000:0.0:1788725904.825958:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.826067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424320 00000100:00100000:2.0:1788725904.826080:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424320 00000100:00100000:2.0:1788725904.826205:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 342 00000100:00100000:2.0:1788725904.826219:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770424320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.826417:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770424320:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 200us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.826426:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 342 00000100:00100000:3.0:1788725904.840831:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.841037:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424448 00000100:00100000:2.0:1788725904.841050:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424448 00000100:00100000:2.0:1788725904.841233:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 343 00000100:00100000:2.0:1788725904.841247:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770424448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.841453:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:6168:x1875614770424448:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 207us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.841463:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 343 00000100:00100000:0.0:1788725904.853967:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.854094:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424576 00000100:00100000:2.0:1788725904.854110:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424576 00000100:00100000:2.0:1788725904.854215:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 344 00000100:00100000:2.0:1788725904.854226:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:10784:x1875614770424576:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725904.854594:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:10784:x1875614770424576:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 368us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.854603:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 344 00000100:00100000:0.0:1788725904.863069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725904.863297:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424704 00000100:00100000:2.0:1788725904.863310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424704 00000100:00100000:2.0:1788725904.863403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 345 00000100:00100000:2.0:1788725904.863415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:10784:x1875614770424704:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788725904.863897:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:10784:x1875614770424704:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 482us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.863908:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 345 10000000:01000000:2.0:1788725904.891980:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725904.891992:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1282214000 from 7 10000000:01000000:2.0:1788725904.892000:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725904.892070:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.892084:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.892102:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725904.892193:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.892302:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.892658:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725904.893544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478656 00000100:00100000:1.0:1788725904.893770:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478656 00000100:00100000:1.0:1788725904.893995:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788725904.894008:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:6509:x1875614791478656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725904.894029:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725904.894052:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f600/0xa13c582691d370f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d370ee expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.894086:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f600/0xa13c582691d370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d370ee expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.894098:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f600/0xa13c582691d370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d370ee expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.894109:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f600, rc 0) 00000100:00100000:1.0:1788725904.894234:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791478656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.894242:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788725904.894353:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725904.894376:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725904.894388:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725904.894486:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.894851:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.894939:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725904.894979:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478784 00000100:00100000:1.0:1788725904.894986:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478784 00000100:00100000:1.0:1788725904.895555:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788725904.895736:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791478784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788725904.896084:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791478784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.896093:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788725904.896324:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.896383:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.896439:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.896477:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.896806:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791478912 00000100:00100000:2.0:1788725904.896813:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791478912 00000100:00100000:2.0:1788725904.896867:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788725904.896878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791478912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.896992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791478912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.897000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788725904.897094:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791478912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.906329:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13785:1875614791479040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725904.906467:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.906523:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725904.906632:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479040 00000100:00100000:1.0:1788725904.906642:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479040 00000100:00100000:1.0:1788725904.906701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788725904.906712:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:13785:x1875614791479040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725904.906887:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:13785:x1875614791479040:12345-0@lo:502:llog_process_th.0 Request processed in 174us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.906904:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788725904.907669:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13785:1875614791479040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725904.907709:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725904.907733:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725904.907737:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788725904.907747:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1282214000 00000020:00000080:3.0:1788725904.907750:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788725904.907900:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725904.907905:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725904.907906:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788725904.907910:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788725904.907912:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725904.907914:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788725904.907930:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1282214000 00000020:00000080:3.0:1788725904.907932:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788725904.909950:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13785:1875614791479168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725904.910063:0:13785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.910149:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725904.910494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479168 00000100:00100000:0.0:1788725904.910504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479168 00000100:00100000:0.0:1788725904.910578:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788725904.910592:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:13785:x1875614791479168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725904.910783:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:13785:x1875614791479168:12345-0@lo:502:llog_process_th.0 Request processed in 193us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725904.910792:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788725904.910972:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13785:1875614791479168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788725904.911005:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788725904.911015:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788725904.911018:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788725904.911024:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788725904.912535:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788725904.912578:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725904.912590:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.912601:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725904.912672:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788725904.912677:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e52d000 from 7 10000000:01000000:3.0:1788725904.912681:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788725904.912736:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725904.912746:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725904.912760:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725904.912788:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.912868:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725904.912922:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.912963:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479296 00000100:00100000:2.0:1788725904.912989:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479296 00000100:00100000:1.0:1788725904.913065:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788725904.913079:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:6509:x1875614791479296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788725904.913096:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725904.913112:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e400/0xa13c582691d37103 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d370fc expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.913169:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e400/0xa13c582691d37103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d370fc expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.913181:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e400/0xa13c582691d37103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d370fc expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725904.913192:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e400, rc 0) 00000100:00100000:1.0:1788725904.913247:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.913254:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788725904.914796:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788725904.914825:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725904.914838:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725904.915240:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.915314:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.915357:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479424 00000100:00100000:0.0:1788725904.915367:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479424 00000100:00100000:3.0:1788725904.915373:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725904.915418:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788725904.915430:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725904.915600:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725904.915609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788725904.920637:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.920734:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788725904.920834:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.920890:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479552 00000100:00100000:3.0:1788725904.920894:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725904.920900:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479552 00000100:00100000:1.0:1788725904.920962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788725904.920974:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725904.921149:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.921158:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788725904.921818:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725904.922405:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13789:1875614791479680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725904.922468:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.922524:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.924166:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479680 00000100:00100000:2.0:1788725904.924181:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479680 00000100:00100000:2.0:1788725904.924248:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788725904.924260:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:13789:x1875614791479680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.924457:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:13789:x1875614791479680:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.924467:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788725904.924843:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13789:1875614791479680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788725904.924894:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725904.924905:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725904.924907:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788725904.924916:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139e52d000 00000020:00000080:0.0:1788725904.924919:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788725904.925001:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788725904.925005:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725904.925007:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788725904.925010:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788725904.925012:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788725904.925014:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788725904.925018:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139e52d000 00000020:00000080:0.0:1788725904.925020:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788725904.925068:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13789:1875614791479808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725904.925151:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.925183:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479808 00000100:00100000:0.0:1788725904.925187:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479808 00000100:00100000:0.0:1788725904.925216:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788725904.925226:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:13789:x1875614791479808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788725904.925307:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:13789:x1875614791479808:12345-0@lo:502:llog_process_th.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725904.925315:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788725904.925760:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283450780 going to sleep for 11 seconds 00000100:00100000:1.0:1788725904.925781:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13789:1875614791479808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725904.925806:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725904.925812:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725904.925814:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788725904.925819:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:3.0:1788725904.926866:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1788725904.927545:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788725904.927576:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725904.927591:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.927604:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725904.927617:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725904.927620:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b13bd660800 from 7 10000000:01000000:2.0:1788725904.927624:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725904.927670:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.927692:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.927705:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725904.927743:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.927815:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.927858:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.927881:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791479936 00000100:00100000:2.0:1788725904.927888:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791479936 00000100:00100000:2.0:1788725904.927942:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788725904.927953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:6509:x1875614791479936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725904.927970:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725904.927984:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383659800/0xa13c582691d37111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3710a expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.928014:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659800/0xa13c582691d37111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3710a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.928025:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383659800/0xa13c582691d37111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3710a expref: 23 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.928036:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659800, rc 0) 00000100:00100000:2.0:1788725904.928080:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791479936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.928087:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788725904.928173:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791479936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725904.928188:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.928198:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725904.928263:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928291:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.928306:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.928317:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480064 00000100:00100000:2.0:1788725904.928320:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480064 00000100:00100000:2.0:1788725904.928338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788725904.928344:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791480064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928456:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138a104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791480064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.928463:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788725904.928489:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928515:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928556:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.928569:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.928580:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480192 00000100:00100000:2.0:1788725904.928583:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480192 00000100:00100000:2.0:1788725904.928597:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788725904.928602:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791480192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928681:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791480192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.928694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788725904.928745:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.928980:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13790:1875614791480320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.929012:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.929029:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480320 00000100:00100000:2.0:1788725904.929032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480320 00000100:00100000:2.0:1788725904.929049:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788725904.929055:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:13790:x1875614791480320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.929142:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:13790:x1875614791480320:12345-0@lo:502:llog_process_th.0 Request processed in 86us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.929149:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788725904.929174:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.929185:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13790:1875614791480320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788725904.929205:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725904.929215:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725904.929218:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788725904.929224:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b13bd660800 00000020:00000080:2.0:1788725904.929227:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788725904.929283:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725904.929594:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725904.929597:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788725904.929601:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788725904.929604:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725904.929605:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788725904.929609:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b13bd660800 00000020:00000080:2.0:1788725904.929611:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788725904.929837:0:13790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13790:1875614791480448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.929883:0:13790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.929909:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480448 00000100:00100000:2.0:1788725904.929913:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480448 00000100:00100000:2.0:1788725904.929937:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788725904.929944:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:13790:x1875614791480448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.930024:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:13790:x1875614791480448:12345-0@lo:502:llog_process_th.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.930031:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788725904.930063:0:13790:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.930079:0:13790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13790:1875614791480448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788725904.930099:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788725904.930104:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788725904.930106:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788725904.930109:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788725904.930281:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788725904.930308:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788725904.930317:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930327:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788725904.930338:0:6509:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788725904.930341:0:6509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139116a000 from 7 10000000:01000000:2.0:1788725904.930344:0:6509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788725904.930368:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930387:0:6509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930398:0:6509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725904.930412:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.930443:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.930459:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.930472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480576 00000100:00100000:2.0:1788725904.930475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480576 00000100:00100000:2.0:1788725904.930495:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788725904.930501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:6509:x1875614791480576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725904.930510:0:6506:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725904.930523:0:6506:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1383659e00/0xa13c582691d3711f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37118 expref: -99 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930546:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1383659e00/0xa13c582691d3711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37118 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930556:0:6506:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1383659e00/0xa13c582691d3711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37118 expref: 24 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930565:0:6506:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659e00, rc 0) 00000100:00100000:2.0:1788725904.930593:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791480576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.930599:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788725904.930637:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788725904.930648:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725904.930657:0:6509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725904.930702:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.931933:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725904.931985:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128191c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.932012:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480704 00000100:00100000:2.0:1788725904.932019:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480704 00000100:00100000:2.0:1788725904.932071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788725904.932084:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791480704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788725904.932413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791480704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.932425:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788725904.932442:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788725904.932546:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788725904.932621:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725904.932663:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283450840 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.932797:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480832 00000100:00100000:2.0:1788725904.932803:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480832 00000100:00100000:1.0:1788725904.933252:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788725904.933268:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791480832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725904.933457:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:6509:x1875614791480832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725904.933466:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788725904.933518:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07aa06c1-b26f-4687-bdcf-2948685dbe8f:6509:1875614791480832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788725904.933752:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13791:1875614791480960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725904.933795:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.933818:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12836540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725904.933892:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791480960 00000100:00100000:2.0:1788725904.933898:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791480960 00000100:00100000:2.0:1788725904.933931:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788725904.933940:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:13791:x1875614791480960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788725904.934030:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:13791:x1875614791480960:12345-0@lo:502:llog_process_th.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725904.934037:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788725904.934229:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13791:1875614791480960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725904.934250:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725904.934259:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725904.934261:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788725904.934268:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139116a000 00000020:00000080:1.0:1788725904.934271:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788725904.934595:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725904.934601:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725904.934602:0:13791:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788725904.934605:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788725904.934608:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725904.934616:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788725904.934621:0:13791:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139116a000 00000020:00000080:1.0:1788725904.934624:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788725904.934670:0:13791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13791:1875614791481088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788725904.934711:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725904.934757:0:13791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12836540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725904.934812:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481088 00000100:00100000:3.0:1788725904.934817:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481088 00000100:00100000:3.0:1788725904.934870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788725904.934879:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:13791:x1875614791481088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788725904.934972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:13791:x1875614791481088:12345-0@lo:502:llog_process_th.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725904.934980:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788725904.935052:0:13791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07aa06c1-b26f-4687-bdcf-2948685dbe8f:13791:1875614791481088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788725904.935072:0:13791:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788725904.935077:0:13791:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788725904.935079:0:13791:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788725904.935084:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788725904.935331:0:6509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788725904.935468:0:6509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788725904.935743:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725904.935756:0:6509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788725904.952424:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788725905.283503:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725905.531478:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725905.531545:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791481216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725905.531641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725905.532245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481216 00000100:00100000:0.0:1788725905.532257:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481216 00000100:00100000:0.0:1788725905.532627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788725905.532643:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791481216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725905.532712:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725905.532814:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791481216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725905.532886:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791481216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725905.541190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000040:00080000:2.0:1788725905.980965:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788725905.982222:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788725906.300188:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725907.072183:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791481344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725907.072281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725907.073168:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481344 00000100:00100000:3.0:1788725907.073182:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481344 00000100:00100000:3.0:1788725907.073477:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788725907.073492:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791481344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788725907.073549:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788725907.073845:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791481344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 357us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725907.073854:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788725907.076921:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791481344:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788725907.323373:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725907.579443:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791481472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725907.579518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725907.579774:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481472 00000100:00100000:3.0:1788725907.579784:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481472 00000100:00100000:3.0:1788725907.579861:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788725907.579863:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791481600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725907.579876:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791481472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725907.579911:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725907.579938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725907.580014:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481600 00000100:00100000:2.0:1788725907.580021:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481600 00000100:00080000:0.0:1788725907.580023:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725907.580065:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788725907.583355:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791481600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725907.583390:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725907.585413:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791481600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5333us (5469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725907.585426:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788725907.585987:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138422c380 x1875614791481600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725907.586033:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791481600:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788725907.587419:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635c00 x1875614791481472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725907.587447:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791481472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725907.588618:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791481472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8741us (9093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725907.588630:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788725907.647028:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725907.647065:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725907.647180:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424960 00000100:00100000:1.0:1788725907.647198:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424960 00000100:00100000:3.0:1788725907.647206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725907.647244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725907.647272:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:0.0:1788725907.647353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725907.647378:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770424832 00000100:00100000:0.0:1788725907.647386:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770424832 00000100:00100000:0.0:1788725907.647431:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 366 00000100:00100000:0.0:1788725907.647440:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770424832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725907.649077:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425216 00000100:00100000:2.0:1788725907.649089:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425216 00000100:00100000:2.0:1788725907.649171:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:2.0:1788725907.649181:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770425216:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725907.650291:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425472 00000100:00100000:1.0:1788725907.650307:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425472 00000100:00100000:1.0:1788725907.650369:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425088 00000100:00100000:1.0:1788725907.650373:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425088 00000100:00100000:1.0:1788725907.650402:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1788725907.650413:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770424960:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725907.653972:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770424832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 6520us (6715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725907.653988:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 366 00000100:00100000:0.0:1788725907.654053:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788725907.654080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770425472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725907.654146:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770425472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (6945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725907.654152:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:0.0:1788725907.654171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:0.0:1788725907.654178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770425088:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725907.654202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770425088:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (6930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725907.654208:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:3.0:1788725907.656403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:3.0:1788725907.656462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725907.656468:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725907.656856:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425344 00000100:00100000:0.0:1788725907.656865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425344 00000100:00100000:0.0:1788725907.656921:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:0.0:1788725907.656932:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770425344:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725907.656996:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770425344:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725907.657004:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00080000:3.0:1788725907.657227:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725907.663244:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770424960:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 12813us (16206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725907.663245:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770425216:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 14045us (16159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725907.663275:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788725907.663299:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00010000:00010000:3.0:1788725908.347509:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788725908.610098:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1788725909.371908:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725909.628251:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791481984:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.628341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725909.628436:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725909.628442:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.628469:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725909.628642:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481984 00000100:00100000:2.0:1788725909.628652:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481984 00000100:00100000:2.0:1788725909.628718:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788725909.628731:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791481856:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.628731:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791481984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725909.628871:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791481728:0@lo:400:kworker.0 00000100:00100000:0.0:1788725909.628910:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482112 00000100:00100000:0.0:1788725909.628914:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482112 00000100:00100000:0.0:1788725909.628961:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788725909.628969:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.638133:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791481984:12345-0@lo:400:kworker.0 Request processed in 9378us (9764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725909.638152:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788725909.638277:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791482624:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.638448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.638525:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791482368:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.638628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.638658:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791482880:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.638861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.638890:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791483392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725909.638914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.638934:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725909.638939:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.638958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.639005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481856 00000100:00100000:3.0:1788725909.639012:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481856 00000100:00100000:3.0:1788725909.639108:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482368 00000100:00100000:3.0:1788725909.639111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482368 00000100:00100000:3.0:1788725909.639154:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482880 00000100:00100000:3.0:1788725909.639157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482880 00000100:00100000:3.0:1788725909.639173:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788725909.639181:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791481856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639230:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791481856:12345-0@lo:400:kworker.0 Request processed in 50us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.639235:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788725909.639249:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788725909.639255:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791482368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639280:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791482368:12345-0@lo:400:kworker.0 Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.639300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788725909.639311:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788725909.639315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791482880:12345-0@lo:400:kworker.0 Request processed in 92us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.639414:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788725909.639432:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483264 00000100:00100000:3.0:1788725909.639435:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483264 00000100:00100000:3.0:1788725909.639459:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788725909.639465:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791483264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639490:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791483264:12345-0@lo:400:kworker.0 Request processed in 26us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.639495:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788725909.639509:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725909.639513:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725909.639536:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788725909.639541:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b138422c700, transno 4294967301 00000100:00100000:3.0:1788725909.639551:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639627:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791482368:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639635:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791482880:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639644:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791481856:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639789:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791482496:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.639832:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.639875:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791481984:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639895:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482496 00000100:00100000:3.0:1788725909.639898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482496 00000100:00100000:3.0:1788725909.639916:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483008 00000100:00100000:3.0:1788725909.639918:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483008 00000100:00100000:3.0:1788725909.639929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788725909.639934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791482496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.639963:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791482496:12345-0@lo:400:kworker.0 Request processed in 28us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.639968:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788725909.639978:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788725909.639984:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791483008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.640006:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791483008:12345-0@lo:400:kworker.0 Request processed in 23us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.640010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1788725909.640020:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788725909.640837:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bdc00 x1875614791482496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725909.640856:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791482496:0@lo:400:kworker.0 00010000:00080000:3.0:1788725909.640877:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bd880 x1875614791483008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725909.640886:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.640976:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483392 00000100:00100000:3.0:1788725909.640980:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483392 00000100:00100000:3.0:1788725909.641022:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788725909.641029:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791483392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725909.641063:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725909.641106:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791483392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.641112:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788725909.641159:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791483392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725909.641177:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791483520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725909.641200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.641225:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483520 00000100:00100000:3.0:1788725909.641228:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483520 00000100:00100000:3.0:1788725909.641253:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788725909.641258:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791483520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788725909.641268:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725909.641291:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791483520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.641297:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788725909.641308:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725909.641337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791483520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725909.642811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725909.642889:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482624 00000100:00100000:2.0:1788725909.642900:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482624 00000100:00100000:2.0:1788725909.642993:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788725909.643007:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791482624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.643086:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791482624:12345-0@lo:400:kworker.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725909.643095:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788725909.643149:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725909.643227:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bd180 x1875614791482624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725909.643245:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791482624:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.643259:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791483136:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.643293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.643384:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483136 00000100:00100000:3.0:1788725909.643394:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483136 00000100:00100000:3.0:1788725909.643454:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788725909.643463:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791483136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.643685:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791483136:12345-0@lo:400:kworker.0 Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.643710:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788725909.643778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725909.643814:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791481728 00000100:00100000:1.0:1788725909.643820:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791481728 00000100:00100000:1.0:1788725909.643872:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788725909.643883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791481728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725909.643925:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791481728:12345-0@lo:400:kworker.0 Request processed in 46us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725909.643932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788725909.644014:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791481728:0@lo:400:kworker.0 00000100:00100000:1.0:1788725909.644023:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791482240:0@lo:400:kworker.0 00000100:00100000:1.0:1788725909.644053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725909.644073:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791482752:0@lo:400:kworker.0 00000100:00100000:1.0:1788725909.644096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725909.644714:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482240 00000100:00100000:3.0:1788725909.644724:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482240 00000100:00100000:3.0:1788725909.644771:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788725909.644780:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791482240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725909.644857:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791482240:12345-0@lo:400:kworker.0 Request processed in 78us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725909.644864:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788725909.644947:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791482752 00000100:00100000:2.0:1788725909.644951:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791482752 00000100:00100000:2.0:1788725909.644998:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788725909.645004:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791482752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.645144:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791482752:12345-0@lo:400:kworker.0 Request processed in 109us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725909.645149:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791482240:0@lo:400:kworker.0 00000100:00100000:2.0:1788725909.645160:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788725909.645182:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833be300 x1875614791482752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725909.645195:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791482752:0@lo:400:kworker.0 00000100:00080000:3.0:1788725909.645306:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725909.645392:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791483136:0@lo:400:kworker.0 00000100:00100000:0.0:1788725909.646047:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791482112:12345-0@lo:400:kworker.0 Request processed in 17072us (17568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725909.646062:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788725909.646264:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791482112:0@lo:400:kworker.0 00010000:00010000:2.0:1788725910.395269:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725910.651699:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791483648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725910.651770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725910.652112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483648 00000100:00100000:1.0:1788725910.652155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483648 00000100:00100000:1.0:1788725910.652332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788725910.652345:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791483648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725910.652398:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725910.652612:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791483648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725910.652620:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788725910.657248:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791483648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788725911.420293:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725912.187416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791483776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725912.187482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725912.187655:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483776 00000100:00100000:2.0:1788725912.187663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483776 00000100:00100000:2.0:1788725912.187720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788725912.187729:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791483776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725912.187991:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788725912.188053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791483776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 324us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.188060:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788725912.188158:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791483776:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725912.444980:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725912.700863:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725912.700885:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791483904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725912.700943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725912.701748:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791483904 00000100:00100000:0.0:1788725912.701757:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791483904 00000100:00100000:0.0:1788725912.701831:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788725912.701842:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791483904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788725912.701877:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725912.701920:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791483904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725912.701926:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1788725912.702132:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82a300 x1875614791483904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725912.702149:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791483904:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788725912.702207:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725912.702215:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725912.702225:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791484032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725912.702254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725912.702327:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484032 00000100:00100000:1.0:1788725912.702331:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484032 00000100:00100000:1.0:1788725912.702363:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788725912.702369:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791484032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725912.702378:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725912.702404:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791484032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725912.702409:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788725912.702453:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788725912.702470:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842b4a80 x1875614791484032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725912.702482:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791484032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725912.788409:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788456:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788485:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788531:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788595:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725912.788620:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425984 00000100:00100000:1.0:1788725912.788629:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425984 00000100:00100000:1.0:1788725912.788691:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788725912.788702:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725912.788766:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725912.788774:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788725912.788914:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425600 00000100:00100000:0.0:1788725912.788920:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425600 00000100:00100000:0.0:1788725912.788958:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 368 00000100:00100000:0.0:1788725912.788966:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770425600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725912.789006:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770425600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725912.789013:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 368 00000100:00100000:2.0:1788725912.789269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425856 00000100:00100000:2.0:1788725912.789274:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425856 00000100:00100000:2.0:1788725912.789312:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426112 00000100:00100000:2.0:1788725912.789315:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426112 00000100:00100000:2.0:1788725912.789328:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770425728 00000100:00100000:2.0:1788725912.789331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770425728 00000100:00100000:2.0:1788725912.789342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426240 00000100:00100000:2.0:1788725912.789344:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426240 00000100:00100000:2.0:1788725912.789357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1788725912.789364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725912.789403:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 39us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.789410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:2.0:1788725912.789424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1788725912.789430:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770426112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725912.789454:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770426112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.789460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:2.0:1788725912.789471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788725912.789477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725912.789500:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770425728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.789506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788725912.789517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:2.0:1788725912.789522:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770426240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725912.789556:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770426240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725912.789572:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00080000:2.0:1788725912.789642:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725912.789646:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725912.789648:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788725913.467288:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725914.493653:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725914.747972:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791484288:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748103:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791484800:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748171:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791485312:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748232:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788725914.748238:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791484416:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748279:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791484928:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748284:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791484160:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748313:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791485440:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748348:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748387:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791485184:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748448:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791485696:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748488:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788725914.748493:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791484544:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748532:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791485056:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.748550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.748566:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791485568:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725914.748785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484288 00000100:00100000:0.0:1788725914.748792:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484288 00000100:00100000:0.0:1788725914.748827:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788725914.748835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791484288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.748887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791484288:12345-0@lo:400:kworker.0 Request processed in 52us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725914.748894:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788725914.748911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484800 00000100:00100000:0.0:1788725914.748914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484800 00000100:00100000:0.0:1788725914.748938:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485312 00000100:00100000:0.0:1788725914.748940:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485312 00000100:00100000:0.0:1788725914.748953:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484928 00000100:00100000:0.0:1788725914.748955:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484928 00000100:00100000:0.0:1788725914.748964:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484544 00000100:00100000:0.0:1788725914.748966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484544 00000100:00100000:0.0:1788725914.748975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485440 00000100:00100000:0.0:1788725914.748977:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485440 00000100:00100000:2.0:1788725914.749018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725914.749046:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485184 00000100:00100000:2.0:1788725914.749050:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485184 00000100:00100000:2.0:1788725914.749071:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485696 00000100:00100000:2.0:1788725914.749079:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485696 00000100:00100000:2.0:1788725914.749093:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485056 00000100:00100000:2.0:1788725914.749095:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485056 00000100:00100000:2.0:1788725914.749106:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485568 00000100:00100000:2.0:1788725914.749108:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485568 00000100:00100000:2.0:1788725914.749147:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788725914.749154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484416 00000100:00100000:2.0:1788725914.749155:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13beba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791485184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749158:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484416 00000100:00100000:1.0:1788725914.749182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484672 00000100:00100000:1.0:1788725914.749185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484672 00000100:00100000:2.0:1788725914.749197:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13beba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791485184:12345-0@lo:400:kworker.0 Request processed in 44us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749198:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788725914.749203:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788725914.749205:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791484416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791484416:12345-0@lo:400:kworker.0 Request processed in 32us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788725914.749251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788725914.749257:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791484672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749278:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791484672:12345-0@lo:400:kworker.0 Request processed in 22us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788725914.749297:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788725914.749304:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749690:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791485696:12345-0@lo:400:kworker.0 Request processed in 384us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749698:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788725914.749713:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788725914.749719:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791485056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749747:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791485056:12345-0@lo:400:kworker.0 Request processed in 28us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749752:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788725914.749764:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788725914.749770:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791485568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749795:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791485568:12345-0@lo:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749800:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788725914.749844:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788725914.749851:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749880:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791484800:12345-0@lo:400:kworker.0 Request processed in 30us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749885:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788725914.749898:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788725914.749904:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791485312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.749930:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791485312:12345-0@lo:400:kworker.0 Request processed in 27us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.749936:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788725914.749948:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788725914.749953:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791484928:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788725914.750092:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c3480 x1875614791485056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725914.750106:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791485056:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.750205:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791485568:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.750219:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791484672:0@lo:400:kworker.0 00010000:00080000:2.0:1788725914.750230:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c2680 x1875614791485184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725914.750238:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791485184:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.750248:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791485696:0@lo:400:kworker.0 00000100:00080000:2.0:1788725914.750288:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725914.750293:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725914.750363:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791484160 00000100:00100000:3.0:1788725914.750369:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791484160 00000100:00100000:3.0:1788725914.750404:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788725914.750411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791484160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725914.750450:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791484160:12345-0@lo:400:kworker.0 Request processed in 40us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725914.750456:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788725914.750541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791485952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725914.750569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725914.750592:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725914.750598:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725914.750618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725914.750643:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485952 00000100:00100000:3.0:1788725914.750647:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485952 00000100:00100000:3.0:1788725914.750691:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791485824 00000100:00100000:3.0:1788725914.750695:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791485824 00000100:00100000:3.0:1788725914.750707:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788725914.750714:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791485952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725914.750733:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788725914.750742:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725914.750746:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725914.750762:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788725914.750765:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791485952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725914.750770:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791484544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725914.750771:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788725914.750781:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788725914.750786:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791485824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788725914.750794:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725914.750811:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791485824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725914.750811:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791484544:12345-0@lo:400:kworker.0 Request processed in 42us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725914.750817:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788725914.750817:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788725914.750844:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791484416:0@lo:400:kworker.0 00000100:00100000:3.0:1788725914.750847:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725914.750856:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791485952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725914.750856:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791484288:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.750866:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791484800:0@lo:400:kworker.0 00000100:00100000:3.0:1788725914.750877:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791484544:0@lo:400:kworker.0 00000100:00100000:2.0:1788725914.750877:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791485312:0@lo:400:kworker.0 00000100:00100000:3.0:1788725914.750885:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791484160:0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.751264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788725914.751272:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725914.751313:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791485440:12345-0@lo:400:kworker.0 Request processed in 42us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725914.752245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00080000:0.0:1788725914.752298:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c2300 x1875614791485440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725914.752312:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791485440:0@lo:400:kworker.0 00000100:00100000:1.0:1788725914.752522:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791484928:12345-0@lo:400:kworker.0 Request processed in 2566us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725914.752530:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1788725914.752904:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788725914.753037:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c1180 x1875614791484928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725914.753068:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791484928:0@lo:400:kworker.0 00000040:00080000:3.0:1788725915.196097:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788725915.198382:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788725915.516671:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725915.771401:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725915.771426:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791486080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725915.771494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725915.771619:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486080 00000100:00100000:1.0:1788725915.771627:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486080 00000100:00100000:1.0:1788725915.771695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788725915.771705:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791486080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725915.771738:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725915.771781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791486080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725915.771788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788725915.771876:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791486080:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788725916.539824:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725917.307897:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791486208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725917.307993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725917.308155:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486208 00000100:00100000:0.0:1788725917.308166:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486208 00000100:00100000:0.0:1788725917.308245:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788725917.308257:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791486208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725917.308299:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725917.308352:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791486208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725917.308360:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788725917.308580:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791486208:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725917.566626:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725917.820787:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725917.820818:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791486336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725917.820912:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725917.821146:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791486464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725917.821207:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725917.821392:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486336 00000100:00100000:1.0:1788725917.821403:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486336 00000100:00100000:1.0:1788725917.821474:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486464 00000100:00100000:1.0:1788725917.821477:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486464 00000100:00100000:1.0:1788725917.821511:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725917.821523:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791486336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725917.821559:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725917.821617:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791486336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725917.821624:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788725917.822418:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788725917.822464:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791486464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725917.822504:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725917.822799:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791486464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725917.822825:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1788725917.822925:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e748a80 x1875614791486464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725917.822946:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791486464:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788725917.822959:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f1180 x1875614791486336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725917.822970:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791486336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788725917.823650:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725917.894231:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725917.894291:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725917.894337:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725917.894413:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426368 00000100:00100000:2.0:1788725917.894428:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426368 00000100:00100000:2.0:1788725917.894485:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 370 00000100:00100000:2.0:1788725917.894496:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770426368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725917.894565:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770426368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725917.894572:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 370 00000100:00100000:0.0:1788725917.894936:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426496 00000100:00100000:0.0:1788725917.894942:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426496 00000100:00100000:0.0:1788725917.894990:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426624 00000100:00100000:0.0:1788725917.894993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426624 00000100:00100000:0.0:1788725917.895014:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:0.0:1788725917.895022:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770426496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725917.895061:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770426496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725917.895067:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:0.0:1788725917.895082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:0.0:1788725917.895088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770426624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725917.895114:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770426624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725917.895144:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00080000:2.0:1788725917.895294:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725917.895298:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725917.917725:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725917.917818:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426752 00000100:00100000:2.0:1788725917.917827:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426752 00000100:00100000:2.0:1788725917.917908:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788725917.917919:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770426752:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1788725917.917948:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d37046 00000100:00080000:2.0:1788725917.917957:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b139f7cd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788725917.918006:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1788725917.918204:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725917.918276:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+2:2394:x1875614770426752:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 350us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725917.918290:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00080000:3.0:1788725917.918659:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725917.928826:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725917.928878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725917.931014:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770426880 00000100:00100000:1.0:1788725917.931028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770426880 00000100:00100000:1.0:1788725917.934789:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427008 00000100:00100000:1.0:1788725917.934802:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427008 00000100:00100000:0.0:1788725917.934885:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:0.0:1788725917.934899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770426880:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725917.934986:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770426880:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 92us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725917.934993:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00080000:2.0:1788725917.936786:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725917.936796:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725917.937023:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:1.0:1788725917.937036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427008:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725917.937102:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427008:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 69us (8223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725917.937109:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00010000:00010000:2.0:1788725918.587461:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725919.612842:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725919.867632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725919.867654:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725919.867725:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.867856:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725919.867867:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791486720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725919.867876:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486592 00000100:00100000:0.0:1788725919.867884:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486592 00000100:00100000:1.0:1788725919.867897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.867921:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486720 00000100:00100000:0.0:1788725919.867934:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788725919.867936:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486720 00000100:00100000:0.0:1788725919.867945:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791486592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725919.867958:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788725919.867963:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791486720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725919.867971:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788725919.867972:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725919.868012:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791486720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725919.868012:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791486592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.868019:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788725919.868073:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725919.868073:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791486720:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788725919.868100:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725919.868468:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791487104:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725919.868520:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725919.868566:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791488128:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725919.868602:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788725919.868607:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791487232:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725919.868659:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791487744:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868681:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725919.868715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487104 00000100:00100000:3.0:1788725919.868719:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487104 00000100:00100000:3.0:1788725919.868750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788725919.868756:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791487104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.868795:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791487104:12345-0@lo:400:kworker.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725919.868802:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788725919.869301:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487616 00000100:00100000:3.0:1788725919.869308:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487616 00000100:00100000:3.0:1788725919.869349:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488128 00000100:00100000:3.0:1788725919.869353:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488128 00000100:00100000:3.0:1788725919.869372:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487232 00000100:00100000:3.0:1788725919.869385:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487232 00000100:00100000:3.0:1788725919.869401:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788725919.869408:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.869449:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791487616:12345-0@lo:400:kworker.0 Request processed in 42us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725919.869455:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788725919.869466:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788725919.869472:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791488128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.869497:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791488128:12345-0@lo:400:kworker.0 Request processed in 26us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725919.869501:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788725919.869511:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788725919.869517:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725919.869638:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788725919.869690:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487744 00000100:00100000:0.0:1788725919.869694:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487744 00000100:00100000:0.0:1788725919.869733:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788725919.869739:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791487744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725919.869775:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791487744:12345-0@lo:400:kworker.0 Request processed in 36us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725919.869780:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788725919.869983:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791487232:12345-0@lo:400:kworker.0 Request processed in 465us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725919.869989:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788725919.870874:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791486848:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.870923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.870960:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791487360:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.870985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.871006:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791487872:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.871050:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788725919.871057:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791486976:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.871139:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791487488:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.871179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791488000:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871198:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725919.871226:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487872 00000100:00100000:1.0:1788725919.871231:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487872 00000100:00100000:1.0:1788725919.871272:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788725919.871280:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791487872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871350:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791487872:12345-0@lo:400:kworker.0 Request processed in 70us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.871358:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788725919.871377:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486976 00000100:00100000:1.0:1788725919.871381:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486976 00000100:00100000:1.0:1788725919.871400:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487488 00000100:00100000:1.0:1788725919.871403:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487488 00000100:00100000:1.0:1788725919.871415:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488000 00000100:00100000:1.0:1788725919.871418:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488000 00000100:00100000:1.0:1788725919.871430:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788725919.871437:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791486976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871467:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791486976:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.871473:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788725919.871485:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788725919.871490:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791487488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871516:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791487488:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.871521:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788725919.871530:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788725919.871546:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791488000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871574:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791488000:12345-0@lo:400:kworker.0 Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.871579:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1788725919.871594:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725919.871598:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725919.871600:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725919.871632:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791487360 00000100:00100000:1.0:1788725919.871636:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791487360 00000100:00100000:1.0:1788725919.871658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788725919.871664:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791487360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871695:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791487360:12345-0@lo:400:kworker.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725919.871713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788725919.871747:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791486976:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871758:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791487488:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871766:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791488000:0@lo:400:kworker.0 00000100:00100000:1.0:1788725919.871774:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791487360:0@lo:400:kworker.0 00010000:00080000:1.0:1788725919.871785:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bf480 x1875614791487872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725919.871795:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791487872:0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.873703:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791486848 00000100:00100000:3.0:1788725919.873716:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791486848 00000100:00100000:3.0:1788725919.873785:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788725919.873802:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791486848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725919.874703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791486848:12345-0@lo:400:kworker.0 Request processed in 906us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725919.874712:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788725919.884297:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791486848:0@lo:400:kworker.0 00000100:00100000:0.0:1788725919.890755:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791487232:0@lo:400:kworker.0 00010000:00080000:0.0:1788725919.890778:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bce00 x1875614791487744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725919.890790:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791487744:0@lo:400:kworker.0 00000100:00100000:0.0:1788725919.890833:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791487104:0@lo:400:kworker.0 00010000:00080000:0.0:1788725919.890847:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b138422c700 x1875614791487616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725919.890856:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138422c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791487616:0@lo:400:kworker.0 00010000:00080000:0.0:1788725919.890868:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833be300 x1875614791488128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725919.890876:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791488128:0@lo:400:kworker.0 00010000:00010000:1.0:1788725920.635916:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725920.893155:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791488256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725920.893250:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725920.893650:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488256 00000100:00100000:1.0:1788725920.893660:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488256 00000100:00100000:1.0:1788725920.893712:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788725920.893722:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791488256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725920.893755:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725920.893807:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791488256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725920.893814:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788725920.893909:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791488256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788725921.659977:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725922.427833:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725922.427856:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791488384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725922.427962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725922.431484:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488384 00000100:00100000:3.0:1788725922.431536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488384 00000100:00100000:3.0:1788725922.431615:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788725922.431626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791488384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788725922.431675:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788725922.431758:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791488384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (3795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725922.431765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788725922.432023:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791488384:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725922.683453:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725922.939433:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725922.939455:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791488640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725922.939575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725922.939703:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488640 00000100:00100000:1.0:1788725922.939711:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488640 00000100:00100000:1.0:1788725922.939787:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788725922.939798:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791488640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725922.939826:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725922.939871:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791488640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.939878:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1788725922.939916:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f2a00 x1875614791488640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725922.939933:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791488640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725922.940003:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725922.940013:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791488512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725922.940043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788725922.940330:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725922.940389:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488512 00000100:00100000:1.0:1788725922.940394:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488512 00000100:00100000:1.0:1788725922.940438:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788725922.940445:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791488512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725922.940455:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725922.940487:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791488512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725922.940492:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788725922.940559:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13812a8000 x1875614791488512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725922.940580:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791488512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788725922.941194:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725923.009445:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725923.009488:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725923.009530:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725923.009547:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725923.009582:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725923.009840:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427392 00000100:00100000:2.0:1788725923.009849:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427392 00000100:00100000:2.0:1788725923.009914:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427648 00000100:00100000:2.0:1788725923.009917:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427648 00000100:00100000:2.0:1788725923.009933:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427264 00000100:00100000:2.0:1788725923.009935:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427264 00000100:00100000:2.0:1788725923.009957:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427520 00000100:00100000:2.0:1788725923.009959:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427520 00000100:00100000:2.0:1788725923.009976:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:2.0:1788725923.009986:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770427392:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725923.010057:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770427392:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725923.010064:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:2.0:1788725923.010081:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:2.0:1788725923.010088:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725923.010114:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725923.010146:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:2.0:1788725923.010159:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:2.0:1788725923.010165:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770427264:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725923.010191:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770427264:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725923.010197:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:2.0:1788725923.010208:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:2.0:1788725923.010215:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725923.010407:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770427520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 192us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725923.010414:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:1.0:1788725923.010930:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427136 00000100:00100000:1.0:1788725923.010936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427136 00000100:00100000:1.0:1788725923.010986:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 372 00000100:00100000:1.0:1788725923.010994:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770427136:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725923.011048:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770427136:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725923.011055:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 372 00000100:00080000:3.0:1788725923.011321:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725923.011326:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788725923.710802:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788725923.990410:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:0.0:1788725923.990419:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b139f7cf800/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:1.0:1788725923.990488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f7cf800/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-OST0001 00000020:00000080:1.0:1788725923.990550:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f7cd800 for lustre-OST0001 00010000:00010000:1.0:1788725924.731979:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725924.989865:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791488768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725924.989932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.990001:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488768 00000100:00100000:1.0:1788725924.990008:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488768 00000100:00100000:1.0:1788725924.990061:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788725924.990072:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791488768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725924.990101:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725924.990163:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791488768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.990171:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788725924.990190:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725924.990725:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791488768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725924.991061:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791488896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725924.991101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.991203:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791488896 00000100:00100000:1.0:1788725924.991208:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791488896 00000100:00100000:1.0:1788725924.991257:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788725924.991266:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791488896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725924.991280:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725924.991312:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791488896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.991333:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788725924.991384:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725924.991411:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791488896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725924.992324:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791489152:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.992364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.992396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791489664:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.992417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.992438:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791490176:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.992457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.992479:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788725924.992484:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791489280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.992550:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.992574:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791489792:0@lo:400:kworker.0 00000100:00100000:0.0:1788725924.992579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489280 00000100:00100000:0.0:1788725924.992585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489280 00000100:00100000:1.0:1788725924.992606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725924.992623:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791490304:0@lo:400:kworker.0 00000100:00100000:0.0:1788725924.992632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788725924.992640:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791489280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.992643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992697:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791489024:0@lo:400:kworker.0 00000100:00100000:0.0:1788725924.992699:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791489280:12345-0@lo:400:kworker.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725924.992724:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788725924.992728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992749:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791489536:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.992772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992787:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791490048:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.992809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992827:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788725924.992832:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791489408:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.992851:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992861:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791489920:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.992879:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725924.992904:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489024 00000100:00100000:3.0:1788725924.992908:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489024 00000100:00100000:3.0:1788725924.992936:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788725924.992950:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791489024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.992985:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791489024:12345-0@lo:400:kworker.0 Request processed in 37us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725924.992991:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788725924.993016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489536 00000100:00100000:3.0:1788725924.993020:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489536 00000100:00100000:3.0:1788725924.993040:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788725924.993047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791489536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.993075:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791489536:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725924.993081:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788725924.993096:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490048 00000100:00100000:3.0:1788725924.993099:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490048 00000100:00100000:3.0:1788725924.993146:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489920 00000100:00100000:3.0:1788725924.993149:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489920 00000100:00100000:3.0:1788725924.993167:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788725924.993173:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791490048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.993203:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791490048:12345-0@lo:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725924.993209:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788725924.993218:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788725924.993224:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791489920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.993248:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791489920:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725924.993254:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1788725924.993290:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b8a80 x1875614791489920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725924.993315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791489920:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.993326:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791489024:0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.993334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791489536:0@lo:400:kworker.0 00010000:00080000:3.0:1788725924.993342:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b8380 x1875614791490048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725924.993349:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791490048:0@lo:400:kworker.0 00000100:00100000:2.0:1788725924.994731:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489664 00000100:00100000:1.0:1788725924.994731:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489152 00000100:00100000:1.0:1788725924.994742:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489152 00000100:00100000:2.0:1788725924.994746:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489664 00000100:00100000:1.0:1788725924.994782:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490176 00000100:00100000:2.0:1788725924.994783:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489792 00000100:00100000:2.0:1788725924.994785:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489792 00000100:00100000:1.0:1788725924.994785:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490176 00000100:00100000:2.0:1788725924.994804:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490304 00000100:00100000:1.0:1788725924.994804:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791489408 00000100:00100000:2.0:1788725924.994807:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490304 00000100:00100000:1.0:1788725924.994807:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791489408 00000100:00100000:1.0:1788725924.994821:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788725924.994829:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791489152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725924.994928:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788725924.994937:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791489664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725924.994975:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791489664:12345-0@lo:400:kworker.0 Request processed in 39us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725924.994982:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788725924.994999:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788725924.995006:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791489792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995017:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791489152:12345-0@lo:400:kworker.0 Request processed in 188us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.995023:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788725924.995032:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791489792:12345-0@lo:400:kworker.0 Request processed in 27us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725924.995037:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788725924.995047:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788725924.995052:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791490176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995139:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788725924.995148:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791489408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995190:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791489408:12345-0@lo:400:kworker.0 Request processed in 45us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.995197:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788725924.995212:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788725924.995219:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791490304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725924.995252:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791489408:0@lo:400:kworker.0 00000100:00080000:3.0:1788725924.995292:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788725924.995298:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788725924.995301:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725924.995308:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791490176:12345-0@lo:400:kworker.0 Request processed in 254us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725924.995321:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788725924.995324:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791490304:12345-0@lo:400:kworker.0 Request processed in 106us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725924.995330:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788725924.995377:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791489280:0@lo:400:kworker.0 00010000:00080000:1.0:1788725924.995395:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833b9880 x1875614791489792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725924.995405:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791489792:0@lo:400:kworker.0 00010000:00080000:1.0:1788725924.995415:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842afb80 x1875614791490304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725924.995423:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791490304:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995434:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791489152:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791489664:0@lo:400:kworker.0 00000100:00100000:1.0:1788725924.995457:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791490176:0@lo:400:kworker.0 00000040:00080000:1.0:1788725925.439010:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788725925.448813:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788725925.756244:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725926.012146:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725926.012169:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791490432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725926.012246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725926.012347:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490432 00000100:00100000:1.0:1788725926.012353:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490432 00000100:00100000:1.0:1788725926.012418:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788725926.012426:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791490432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725926.012457:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725926.012501:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791490432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725926.012509:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788725926.012545:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791490432:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725926.779299:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725927.553751:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791490560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725927.553815:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725927.554173:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490560 00000100:00100000:0.0:1788725927.554181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490560 00000100:00100000:0.0:1788725927.554225:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788725927.554233:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791490560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725927.554261:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788725927.554338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791490560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725927.554345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788725927.554789:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791490560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725927.806269:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725928.059351:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725928.059415:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791490688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725928.059612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725928.062996:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725928.063017:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725928.063076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725928.078521:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490688 00000100:00100000:1.0:1788725928.078538:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490688 00000100:00100000:1.0:1788725928.078688:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490816 00000100:00100000:1.0:1788725928.078693:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490816 00000100:00100000:3.0:1788725928.080379:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788725928.080396:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791490688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788725928.080435:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725928.080509:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791490688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (20897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725928.080516:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788725928.080960:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139e7f2a00 x1875614791490688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725928.080985:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791490688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788725928.085020:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725928.088955:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788725928.088972:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791490816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725928.088999:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725928.089085:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791490816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (26009us total) trans 0 rc 0/0 00010000:00080000:2.0:1788725928.089169:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c1180 x1875614791490816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725928.089189:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791490816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725928.097696:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788725928.136424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725928.136459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725928.136483:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725928.136501:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725928.136532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725928.136558:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428032 00000100:00100000:1.0:1788725928.136578:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428032 00000100:00100000:1.0:1788725928.136632:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428288 00000100:00100000:1.0:1788725928.136636:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428288 00000100:00100000:1.0:1788725928.136662:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427904 00000100:00100000:1.0:1788725928.136665:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427904 00000100:00100000:1.0:1788725928.136675:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428160 00000100:00100000:1.0:1788725928.136677:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428160 00000100:00100000:1.0:1788725928.136693:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:1.0:1788725928.136702:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770428032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725928.136786:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770428032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725928.136793:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:1.0:1788725928.136809:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:1.0:1788725928.136815:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770428288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725928.136841:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770428288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725928.136846:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:1.0:1788725928.136857:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:1.0:1788725928.136862:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770427904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725928.136887:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770427904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725928.136893:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:1.0:1788725928.136903:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:1.0:1788725928.136908:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770428160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725928.136930:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770428160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725928.136935:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00080000:1.0:1788725928.136957:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725928.136966:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725928.137520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770427776 00000100:00100000:3.0:1788725928.137526:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770427776 00000100:00100000:3.0:1788725928.137559:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 374 00000100:00100000:3.0:1788725928.137579:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770427776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725928.137624:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770427776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 58us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725928.137631:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 374 00010000:00010000:3.0:1788725928.833722:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725929.851434:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725930.107890:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791491328:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.107955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108002:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791491840:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108046:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791492352:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108090:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788725930.108096:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791491200:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108139:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108172:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791491712:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108212:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791492224:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.108259:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491328 00000100:00100000:1.0:1788725930.108267:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491328 00000100:00100000:1.0:1788725930.108308:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491712 00000100:00100000:1.0:1788725930.108311:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491712 00000100:00100000:1.0:1788725930.108334:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492224 00000100:00100000:1.0:1788725930.108336:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492224 00000100:00100000:1.0:1788725930.108351:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788725930.108358:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791491328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108407:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791491328:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.108413:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788725930.108430:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788725930.108450:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108694:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791491712:12345-0@lo:400:kworker.0 Request processed in 244us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.108702:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788725930.108716:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788725930.108723:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108750:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791492224:12345-0@lo:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.108756:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788725930.108775:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491840 00000100:00100000:1.0:1788725930.108780:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491840 00000100:00100000:1.0:1788725930.108805:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492352 00000100:00100000:1.0:1788725930.108808:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492352 00000100:00100000:1.0:1788725930.108826:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788725930.108832:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108860:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791491840:12345-0@lo:400:kworker.0 Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.108865:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788725930.108876:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788725930.108882:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791492352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.108907:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791492352:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.108912:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788725930.108931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491200 00000100:00100000:1.0:1788725930.108935:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491200 00000100:00100000:1.0:1788725930.108959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788725930.108964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.109002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791491200:12345-0@lo:400:kworker.0 Request processed in 37us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725930.109008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788725930.109025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791490944:0@lo:400:kworker.0 00000100:00080000:1.0:1788725930.109030:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725930.109034:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725930.109036:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725930.109057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.109071:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109080:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791491456:0@lo:400:kworker.0 00010000:00080000:1.0:1788725930.109082:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af862d80 x1875614791491712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725930.109092:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791491712:0@lo:400:kworker.0 00010000:00080000:1.0:1788725930.109102:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1281a2b100 x1875614791492224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725930.109110:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791492224:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725930.109139:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791491328:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109149:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791491968:0@lo:400:kworker.0 00010000:00080000:1.0:1788725930.109149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af861500 x1875614791491840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725930.109170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725930.109186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791492480:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725930.109561:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788725930.109570:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791491072:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725930.109623:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791492608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725930.109641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791491584:0@lo:400:kworker.0 00000100:00100000:2.0:1788725930.109649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725930.109660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725930.109673:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791492096:0@lo:400:kworker.0 00000100:00100000:2.0:1788725930.109684:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491456 00000100:00100000:2.0:1788725930.109687:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491456 00000100:00100000:3.0:1788725930.109691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725930.109713:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788725930.109720:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791491456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.109727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791490944 00000100:00100000:3.0:1788725930.109730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791490944 00000100:00100000:2.0:1788725930.109755:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791491456:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725930.109761:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788725930.109808:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492608 00000100:00100000:2.0:1788725930.109812:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492608 00000100:00100000:2.0:1788725930.109835:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788725930.109842:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791492608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725930.109862:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725930.109899:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791492608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725930.109904:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788725930.109922:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791492736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725930.109942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725930.109978:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791492608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725930.110007:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791491456:0@lo:400:kworker.0 00000100:00100000:2.0:1788725930.110038:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491968 00000100:00100000:2.0:1788725930.110042:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491968 00000100:00100000:2.0:1788725930.110067:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492480 00000100:00100000:2.0:1788725930.110070:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492480 00000100:00100000:2.0:1788725930.110088:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788725930.110094:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791491968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725930.110147:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791491968:12345-0@lo:400:kworker.0 Request processed in 53us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725930.110153:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788725930.110196:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788725930.110204:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791490944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110347:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791490944:12345-0@lo:400:kworker.0 Request processed in 144us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725930.110360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788725930.110390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491072 00000100:00100000:3.0:1788725930.110394:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491072 00000100:00100000:3.0:1788725930.110415:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791491584 00000100:00100000:3.0:1788725930.110418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791491584 00000100:00100000:3.0:1788725930.110435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492096 00000100:00100000:3.0:1788725930.110438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492096 00000100:00100000:3.0:1788725930.110453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788725930.110460:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791491072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791491072:12345-0@lo:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725930.110497:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788725930.110508:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788725930.110514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791491584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791491584:12345-0@lo:400:kworker.0 Request processed in 25us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725930.110539:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788725930.110545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788725930.110546:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791492480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110568:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788725930.110573:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791492096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725930.110587:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791492480:12345-0@lo:400:kworker.0 Request processed in 42us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725930.110593:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788725930.110594:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791492096:12345-0@lo:400:kworker.0 Request processed in 22us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725930.110599:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788725930.110647:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791491072:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110657:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791491584:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791492096:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110682:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791490944:0@lo:400:kworker.0 00010000:00080000:3.0:1788725930.110692:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12836f7100 x1875614791491968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725930.110700:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791491968:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110708:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791492480:0@lo:400:kworker.0 00000100:00100000:3.0:1788725930.110746:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492736 00000100:00100000:1.0:1788725930.111027:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791491840:0@lo:400:kworker.0 00000100:00100000:1.0:1788725930.111046:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791492352:0@lo:400:kworker.0 00000100:00080000:1.0:1788725930.111100:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725930.111104:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725930.111106:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725930.114636:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492736 00000100:00100000:3.0:1788725930.114722:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788725930.114732:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791492736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725930.114758:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725930.114831:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791492736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725930.114838:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788725930.118139:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791492736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788725930.875313:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725931.132762:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791492864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725931.132861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725931.132985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492864 00000100:00100000:0.0:1788725931.132995:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492864 00000100:00100000:0.0:1788725931.133067:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788725931.133080:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791492864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725931.133150:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725931.133209:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791492864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725931.133217:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788725931.133270:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791492864:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788725931.254291:0:14052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:18:48 (1788725928) 00010000:00010000:3.0:1788725931.900694:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725932.667898:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791492992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725932.667999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725932.668176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791492992 00000100:00100000:1.0:1788725932.668187:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791492992 00000100:00100000:1.0:1788725932.668276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788725932.668287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791492992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725932.668398:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788725932.668471:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791492992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725932.668478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788725932.668637:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791492992:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725932.923830:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725933.182171:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725933.182282:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725933.182426:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493120 00000100:00100000:0.0:1788725933.182438:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493120 00000100:00100000:0.0:1788725933.182516:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788725933.182543:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791493120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788725933.182600:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788725933.182732:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725933.182744:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725933.182756:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791493248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725933.182792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725933.182846:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493248 00000100:00100000:1.0:1788725933.182851:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493248 00000100:00100000:1.0:1788725933.182882:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788725933.182889:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791493248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725933.182899:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725933.182933:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791493248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.182940:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1788725933.182960:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788725933.182988:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82bb80 x1875614791493248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725933.183007:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791493248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725933.191728:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791493120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9187us (9430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725933.191747:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1788725933.210221:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b139f7c1180 x1875614791493120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788725949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725933.210271:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791493120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725933.222864:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725933.223065:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428416 00000100:00100000:3.0:1788725933.223098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428416 00000100:00100000:3.0:1788725933.223224:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00080000:1.0:1788725933.223348:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725933.224073:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:11075:x1875614770428416:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725933.224102:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725933.228328:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6da2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228490:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228504:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228518:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725933.228696:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788725933.228700:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725933.228742:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228772:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da2 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228794:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da2 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725933.228803:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:2.0:1788725933.228806:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788725933.228822:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725933.229197:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:11075:x1875614770428416:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5135us (6356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725933.230215:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1788725933.235847:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725933.235961:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428544 00000100:00100000:1.0:1788725933.235972:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428544 00000100:00100000:1.0:1788725933.236048:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788725933.236059:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+6:11076:x1875614770428544:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788725933.236079:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725933.236098:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6da9 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236192:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236206:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236218:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236233:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236239:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236245:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236302:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236311:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236317:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725933.236381:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788725933.236385:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725933.236407:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236419:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236424:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236431:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236436:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725933.236440:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236447:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236459:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:1.0:1788725933.236462:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725933.236466:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236472:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3713b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236484:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236500:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236506:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236511:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725933.236514:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236521:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236529:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b1283237900) 00010000:00010000:1.0:1788725933.236543:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725933.236547:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236553:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236822:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da9 expref: 8 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236837:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da9 expref: 7 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725933.236845:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283237c00) 00010000:00010000:1.0:1788725933.236847:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725933.236856:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e200, rc 0) 00000100:00100000:1.0:1788725933.236978:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+7:11076:x1875614770428544:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 920us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.236986:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788725933.243444:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725933.243519:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428672 00000100:00100000:0.0:1788725933.243528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428672 00000100:00100000:0.0:1788725933.243606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788725933.243624:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:78ae299a-14d0-4856-aa24-442bf24804dd+7:11076:x1875614770428672:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788725933.243703:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:78ae299a-14d0-4856-aa24-442bf24804dd+7:11076:x1875614770428672:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725933.243711:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788725933.245826:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725933.245884:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725933.245979:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428928 00000100:00100000:2.0:1788725933.245991:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428928 00000100:00100000:2.0:1788725933.246073:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429184 00000100:00100000:2.0:1788725933.246077:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429184 00000100:00100000:2.0:1788725933.246144:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:2.0:1788725933.246156:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770428928:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725933.246238:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770428928:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725933.246246:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:2.0:1788725933.246265:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00100000:2.0:1788725933.246272:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770429184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725933.246297:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770429184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725933.246304:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 262 00000100:00080000:1.0:1788725933.246949:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725933.247272:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725933.247313:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725933.247375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770428800 00000100:00100000:3.0:1788725933.247382:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770428800 00000100:00100000:3.0:1788725933.247436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 376 00000100:00100000:3.0:1788725933.247446:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770428800:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725933.247501:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770428800:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725933.247507:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 376 00000100:00100000:1.0:1788725933.248015:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429056 00000100:00100000:1.0:1788725933.248021:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429056 00000100:00100000:1.0:1788725933.248086:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00100000:1.0:1788725933.248094:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770429056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725933.248332:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770429056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 238us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.248340:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 263 00000100:00080000:2.0:1788725933.248556:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725933.248945:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725933.249017:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429440 00000100:00100000:0.0:1788725933.249023:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429440 00000100:00100000:0.0:1788725933.249077:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788725933.249086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:11076:x1875614770429440:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725933.249103:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725933.249158:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d37150 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6db0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.249244:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.249261:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.249274:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.250771:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.250799:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.250871:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.250998:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af400/0xa13c582691d37165 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251007:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af400/0xa13c582691d37165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251014:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af400/0xa13c582691d37165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725933.251026:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788725933.251174:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251182:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251189:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251194:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725933.251199:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251226:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251241:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283237c00) 00010000:00010000:0.0:1788725933.251245:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725933.251251:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251258:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d37157 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251272:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251277:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251283:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251287:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725933.251290:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251303:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251311:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b1394485e00) 00010000:00010000:0.0:1788725933.251313:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725933.251316:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.251332:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d3715e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.254205:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d37150 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6db0 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.254232:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af400/0xa13c582691d37165 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6db0 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725933.254242:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725933.254244:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725933.254248:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af400, rc 0) 00000100:00100000:0.0:1788725933.254316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:11076:x1875614770429440:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5230us (5371us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788725933.254324:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788725933.260157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725933.260276:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429568 00000100:00100000:3.0:1788725933.260287:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429568 00000100:00100000:3.0:1788725933.260345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788725933.260357:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:11076:x1875614770429568:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788725933.260463:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:11076:x1875614770429568:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 108us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725933.260482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788725933.265498:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725933.265663:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429696 00000100:00100000:1.0:1788725933.265672:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429696 00000100:00100000:1.0:1788725933.265729:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788725933.265739:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:11076:x1875614770429696:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788725933.268281:0:11950:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2501us 00000100:00100000:1.0:1788725933.335477:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:11076:x1875614770429696:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 69719us (69969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725933.335491:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000040:00080000:0.0:1788725933.628316:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788725933.629947:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788725933.947785:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725934.974955:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725935.227719:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725935.227750:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725935.227846:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.227978:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493376 00000100:00100000:2.0:1788725935.228008:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493376 00000100:00100000:2.0:1788725935.228086:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788725935.228098:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791493376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725935.228156:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725935.228210:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791493376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.228217:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788725935.228447:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725935.228492:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139f7c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791493376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725935.236394:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725935.236428:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791493504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725935.236535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.236774:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791493632:0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.236814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.236861:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791494144:0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.236890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.236909:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725935.236915:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791494016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.236941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725935.237021:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493504 00000100:00100000:0.0:1788725935.237032:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493504 00000100:00100000:0.0:1788725935.237149:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788725935.237162:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791493504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725935.237189:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725935.237256:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791493504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237263:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788725935.237303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494016 00000100:00100000:0.0:1788725935.237307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494016 00000100:00100000:0.0:1788725935.237339:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788725935.237346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791494016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237391:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791494016:12345-0@lo:400:kworker.0 Request processed in 45us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788725935.237425:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791493760:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725935.237473:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791494272:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725935.237513:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725935.237542:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791493888:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237566:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725935.237606:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493760 00000100:00100000:0.0:1788725935.237610:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493760 00000100:00100000:0.0:1788725935.237636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494272 00000100:00100000:0.0:1788725935.237639:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494272 00000100:00100000:0.0:1788725935.237658:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788725935.237664:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791493760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237700:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791493760:12345-0@lo:400:kworker.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788725935.237734:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788725935.237747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791494272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237777:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791494272:12345-0@lo:400:kworker.0 Request processed in 31us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788725935.237806:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494144 00000100:00100000:0.0:1788725935.237810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494144 00000100:00100000:0.0:1788725935.237833:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493888 00000100:00100000:0.0:1788725935.237836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493888 00000100:00100000:0.0:1788725935.237851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788725935.237859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237907:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791494144:12345-0@lo:400:kworker.0 Request processed in 49us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237912:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788725935.237924:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788725935.237930:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.237958:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791493888:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.237964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788725935.238014:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791493888:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.238025:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791493760:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.238035:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791494272:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.238076:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791494016:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.238086:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791494144:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.238105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791493504:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788725935.238515:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725935.238534:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725935.240155:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725935.240385:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791494400:0@lo:400:kworker.0 00000100:00100000:2.0:1788725935.240464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.240534:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494400 00000100:00100000:2.0:1788725935.240544:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494400 00000100:00100000:2.0:1788725935.240620:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788725935.240630:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791494400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725935.240688:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791494400:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.240695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788725935.241213:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788725935.241249:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128259aa00 x1875614791494400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725935.241266:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791494400:0@lo:400:kworker.0 00000100:00100000:2.0:1788725935.241315:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791493632 00000100:00100000:2.0:1788725935.241321:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791493632 00000100:00100000:2.0:1788725935.241357:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788725935.241364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791493632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.247463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791494656:0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.250190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725935.250292:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791494528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725935.250365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725935.250571:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494656 00000100:00100000:3.0:1788725935.250583:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494656 00000100:00100000:3.0:1788725935.250836:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494528 00000100:00100000:3.0:1788725935.250840:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494528 00000100:00100000:3.0:1788725935.250902:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788725935.250913:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791494656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725935.250983:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791494656:12345-0@lo:400:kworker.0 Request processed in 72us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725935.250990:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788725935.251008:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788725935.251015:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791494528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725935.251039:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791494528:12345-0@lo:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725935.251044:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788725935.251079:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725935.251144:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725935.251156:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791494784:0@lo:400:kworker.0 00000100:00100000:3.0:1788725935.251188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725935.251229:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791494912:0@lo:400:kworker.0 00000100:00100000:3.0:1788725935.251247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725935.253109:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791493632:12345-0@lo:400:kworker.0 Request processed in 11731us (16279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725935.253168:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788725935.254239:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494784 00000100:00100000:0.0:1788725935.254254:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494784 00000100:00100000:0.0:1788725935.254344:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791494912 00000100:00100000:0.0:1788725935.254348:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791494912 00000100:00100000:0.0:1788725935.254377:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788725935.254389:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791494784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.254494:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791494784:12345-0@lo:400:kworker.0 Request processed in 107us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.254500:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788725935.254518:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788725935.254536:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791494912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.254569:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791494912:12345-0@lo:400:kworker.0 Request processed in 34us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.254574:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00080000:0.0:1788725935.254646:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128259b800 x1875614791494912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725935.254664:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791494912:0@lo:400:kworker.0 00000100:00100000:0.0:1788725935.254679:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791494784:0@lo:400:kworker.0 00000100:00080000:2.0:1788725935.257248:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725935.257260:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725935.262228:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791493632:0@lo:400:kworker.0 00010000:00080000:1.0:1788725935.262298:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128259ad80 x1875614791494656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725935.262312:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791494656:0@lo:400:kworker.0 00010000:00080000:1.0:1788725935.262326:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1282598e00 x1875614791494528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788725951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725935.262334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791494528:0@lo:400:kworker.0 00000040:00080000:0.0:1788725935.676727:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788725935.687231:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788725935.839111:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725935.839175:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770429824 00000100:00100000:2.0:1788725935.839184:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770429824 00000100:00100000:2.0:1788725935.839259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788725935.839269:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+9:11119:x1875614770429824:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725935.839287:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725935.839306:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6db7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839391:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839404:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839415:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839427:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839434:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839440:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839506:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839513:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839529:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839536:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725935.839540:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839547:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839559:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:2.0:1788725935.839562:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725935.839566:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839803:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3717a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839819:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839825:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839831:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839842:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725935.839845:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839850:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839858:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b12819cbe00) 00010000:00010000:2.0:1788725935.839861:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725935.839864:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839869:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37181 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839899:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37173 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6db7 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839909:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:2.0:1788725935.839911:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725935.839914:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6db7 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725935.839925:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725935.839988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+9:11119:x1875614770429824:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 720us (885us total) trans 0 rc 301/301 00000100:00100000:2.0:1788725935.839996:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00080000:0.0:1788725935.841538:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725935.854295:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725935.854569:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430080 00000100:00100000:0.0:1788725935.854579:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430080 00000100:00100000:0.0:1788725935.854651:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788725935.854662:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+9:11119:x1875614770430080:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788725935.854717:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725935.854751:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3712d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da2 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854771:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:0.0:1788725935.854781:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725935.854852:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854865:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854885:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854898:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854905:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.854911:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855424:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855434:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855442:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725935.855454:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011092b19 reply state 000000008f6f2307 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855470:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855476:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725935.855479:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788725935.855482:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788725935.855486:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788725935.855494:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855500:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855506:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855511:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afe00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725935.855528:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855536:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855545:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725935.855548:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725935.855552:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855558:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d37188 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725935.855580:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011092b19 reply state 000000008f6f2307 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855594:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.855599:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b1382afe600) 00010000:00010000:0.0:1788725935.855601:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788725935.855603:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788725935.855705:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+10:11119:x1875614770430080:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 1043us (1418us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788725935.855713:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788725935.981252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725935.981935:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430208 00000100:00100000:0.0:1788725935.981946:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430208 00000100:00100000:0.0:1788725935.982082:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788725935.982093:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+10:11127:x1875614770430208:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788725935.982147:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725935.982169:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d3719d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dbe expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982233:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982249:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982260:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725935.982318:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788725935.982323:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725935.982361:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982386:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d3719d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dbe expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982404:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dbe expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725935.982413:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725935.982415:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725935.982419:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6aea00, rc 0) 00000100:00100000:0.0:1788725935.982487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+11:11127:x1875614770430208:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 396us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725935.982494:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00010000:00010000:1.0:1788725936.000759:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725936.019319:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.019463:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430336 00000100:00100000:0.0:1788725936.019475:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430336 00000100:00100000:0.0:1788725936.019619:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788725936.019631:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+11:11133:x1875614770430336:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725936.019651:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.019670:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d371ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dc5 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019729:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019757:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019766:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019776:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019783:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019788:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019852:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019858:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019865:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725936.019895:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788725936.019898:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725936.019934:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019946:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019964:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019972:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019977:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725936.019982:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.019990:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020002:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725936.020005:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725936.020009:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020016:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af600/0xa13c582691d371b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020029:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020035:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020041:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020046:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6af000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725936.020055:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020062:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020070:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b1382afe600) 00010000:00010000:0.0:1788725936.020072:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725936.020075:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020080:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af000/0xa13c582691d371b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020106:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afe00/0xa13c582691d371ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dc5 expref: 13 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020277:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dc5 expref: 12 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.020286:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725936.020288:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788725936.020291:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b139e6af200, rc 0) 00000100:00100000:0.0:1788725936.020351:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+12:11133:x1875614770430336:12345-192.168.203.12@tcp:101:bash.0 Request processed in 722us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.020356:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1788725936.022654:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.022750:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430592 00000100:00100000:0.0:1788725936.022759:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430592 00000100:00100000:0.0:1788725936.022866:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:0.0:1788725936.022877:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+12:11133:x1875614770430592:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725936.022917:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.022941:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d371c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dcc expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.023051:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.023064:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.023075:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.024670:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.024689:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.024699:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788725936.025020:0:11950:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788725936.025163:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025170:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025175:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025213:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025220:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025226:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025232:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725936.025236:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025243:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025254:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725936.025257:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725936.025261:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025267:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d371ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725936.025280:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006586db4f reply state 0000000037151756 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025289:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025293:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:0.0:1788725936.025298:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788725936.025301:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788725936.025330:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afa00/0xa13c582691d371c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 15 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025344:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 14 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.025351:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:0.0:1788725936.025353:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725936.025356:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788725936.025493:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+15:11133:x1875614770430592:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2619us (2848us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788725936.025500:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788725936.029432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725936.029701:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430720 00000100:00100000:3.0:1788725936.029711:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430720 00000100:00100000:3.0:1788725936.029793:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788725936.029802:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1875614770430720:12345-192.168.203.12@tcp:8:bash.0 00010000:00080000:3.0:1788725936.029844:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1788725936.029872:0:8427:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d371ea 00002000:00100000:3.0:1788725936.029883:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 78ae299a-14d0-4856-aa24-442bf24804dd/ffff9b13874ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788725936.029913:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788725936.029984:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788725936.030010:0:8427:0:(import.c:65:import_set_state_nolock()) ffff9b13874ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788725936.030080:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770430720:12345-192.168.203.12@tcp:8:bash.0 Request processed in 276us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725936.030087:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:2.0:1788725936.032954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725936.033034:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430848 00000100:00100000:3.0:1788725936.033043:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430848 00000100:00080000:0.0:1788725936.033260:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725936.033297:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788725936.033309:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:0:x1875614770430848:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788725936.033326:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725936.033347:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dd3 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788725936.033370:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788725936.033387:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1788725936.033391:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725936.033400:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.033420:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.033434:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045200, rc 0) 00000100:00100000:3.0:1788725936.033496:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:0:x1875614770430848:12345-192.168.203.12@tcp:101:bash.0 Request processed in 189us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725936.033530:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:2.0:1788725936.036794:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725936.037190:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770430976 00000100:00100000:1.0:1788725936.037200:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770430976 00000100:00100000:1.0:1788725936.037259:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788725936.037270:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:11133:x1875614770430976:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725936.037300:0:8716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725936.037320:0:8716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dda expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.037348:0:8716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.037356:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725936.037360:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725936.037364:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 8 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.037408:0:8716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.037422:0:8716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725936.037436:0:8716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13855d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791495040:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725936.037752:0:8716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725936.040803:0:8716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13855d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791495040:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725936.040849:0:8716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 8 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.040868:0:8716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fe00, rc 0) 00000100:00100000:3.0:1788725936.040965:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:11133:x1875614770430976:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3696us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725936.040973:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788725936.042256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.042384:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770431104 00000100:00100000:0.0:1788725936.042393:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770431104 00010000:00010000:0.0:1788725936.042427:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725936.042458:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788725936.042467:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770431104:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725936.042480:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725936.042500:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.042513:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.042560:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f10fab/0xa13c582691d371f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dd3 expref: 8 pid: 8425 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.042576:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725936.042581:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725936.042588:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.042598:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.042632:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725936.042646:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875614791495168:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788725936.042721:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788725936.047019:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.047075:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770431360 00000100:00100000:2.0:1788725936.047085:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770431360 00000100:00100000:2.0:1788725936.047171:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788725936.047181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:11133:x1875614770431360:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788725936.047182:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1875614791495168:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788725936.047203:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725936.047248:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770431104:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4782us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.047256:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788725936.047429:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+16:11133:x1875614770431360:12345-192.168.203.12@tcp:35:bash.0 Request processed in 250us (418us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788725936.047437:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788725936.108381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.108582:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770431616 00000100:00100000:2.0:1788725936.108592:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770431616 00000100:00100000:2.0:1788725936.108701:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788725936.108712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+16:11143:x1875614770431616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725936.108734:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725936.108753:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d371ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6de1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725936.108856:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788725936.108945:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d371ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6de1 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.108959:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:2.0:1788725936.108962:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788725936.108967:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d371ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6de1 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.108998:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659600, rc 0) 00000100:00100000:2.0:1788725936.109059:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+17:11143:x1875614770431616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 348us (693us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788725936.109066:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:1.0:1788725936.111812:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.111956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770431872 00000100:00100000:2.0:1788725936.111967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770431872 00000100:00100000:2.0:1788725936.112024:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788725936.112035:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:11143:x1875614770431872:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725936.112287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:11143:x1875614770431872:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 248us (479us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788725936.112295:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788725936.173752:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.174845:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432000 00000100:00100000:0.0:1788725936.174857:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432000 00000100:00100000:0.0:1788725936.174918:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788725936.174942:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:11149:x1875614770432000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725936.174965:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.174985:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d3720d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6de8 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175546:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175562:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175573:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725936.175615:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788725936.175618:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725936.175638:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175677:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d3720d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6de8 expref: 20 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175695:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6de8 expref: 19 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.175702:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725936.175705:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725936.175709:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9200, rc 0) 00000100:00100000:0.0:1788725936.175776:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:11149:x1875614770432000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 835us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.175797:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788725936.183395:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.183750:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432256 00000100:00100000:0.0:1788725936.183761:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432256 00000100:00100000:0.0:1788725936.183836:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788725936.183847:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:11149:x1875614770432256:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725936.183870:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.183890:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d3721b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6def expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.183999:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.184012:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.184023:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725936.184035:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788725936.185484:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d3721b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6def expref: 22 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.185511:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6def expref: 21 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.185532:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:0.0:1788725936.185535:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725936.185538:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8e00, rc 0) 00000100:00100000:0.0:1788725936.186805:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+21:11149:x1875614770432256:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2952us (3421us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788725936.186827:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788725936.202015:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.202531:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432384 00000100:00100000:2.0:1788725936.202541:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432384 00000100:00100000:2.0:1788725936.202607:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788725936.202617:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+21:2395:x1875614770432384:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725936.202633:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725936.202738:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6def expref: 21 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.202760:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:2.0:1788725936.202765:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725936.202870:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+20:2395:x1875614770432384:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 254us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725936.202878:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788725936.207717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.207792:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432640 00000100:00100000:2.0:1788725936.207801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432640 00000100:00100000:2.0:1788725936.207866:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788725936.207877:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:11149:x1875614770432640:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725936.207900:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725936.207917:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37230 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6df6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.208016:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.208037:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.208055:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725936.208067:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788725936.208211:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37230 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6df6 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.208227:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6df6 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.208236:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:2.0:1788725936.208239:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788725936.208242:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658800, rc 0) 00000100:00100000:2.0:1788725936.208291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:11149:x1875614770432640:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 416us (582us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788725936.208314:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:2.0:1788725936.223772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.223946:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432768 00000100:00100000:0.0:1788725936.223956:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432768 00000100:00100000:0.0:1788725936.224014:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788725936.224025:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770432768:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:0.0:1788725936.224079:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.224099:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.224107:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725936.224112:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788725936.224165:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.224204:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.224218:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 7 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725936.224232:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791495296:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725936.224324:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725936.234753:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791495296:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725936.234781:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725936.244032:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.245899:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770432896 00000100:00100000:0.0:1788725936.245913:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770432896 00002000:00100000:0.0:1788725936.245967:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9b13af865f80 x1875614770432896/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:332/0 lens 504/0 e 0 to 0 dl 1788725947 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788725936.245978:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af865f80 with x1875614770432896 ext(0->12) 00010000:00010000:0.0:1788725936.245987:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 8 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.246004:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 8 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725936.246012:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b13af865f80 00000100:00100000:0.0:1788725936.246451:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788725936.246464:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770432896:12345-192.168.203.12@tcp:4:lfs.0 00000001:00100000:3.0:1788725936.250803:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000100:00100000:2.0:1788725936.253162:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13855d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791495424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725936.253229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725936.253332:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791495424 00000100:00100000:1.0:1788725936.253353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791495424 00000100:00100000:1.0:1788725936.253406:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788725936.253416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791495424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788725936.253448:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788725936.253506:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791495424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725936.253522:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788725936.254958:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13855d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791495424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725936.255937:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770432896:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 9470us (11915us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788725936.255953:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:2.0:1788725936.255965:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9b13af865f80 x1875614770432896/t4294967300(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:332/0 lens 504/448 e 0 to 0 dl 1788725947 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788725936.255977:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af865f80 with x1875614770432896 ext(0->12) 00010000:00010000:2.0:1788725936.255987:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.256004:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788725936.256013:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b13af865f80 00000100:00100000:2.0:1788725936.260183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725936.260363:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770433024 00000100:00100000:1.0:1788725936.260374:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770433024 00010000:00010000:1.0:1788725936.260415:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725936.260458:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:1.0:1788725936.260468:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770433024:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725936.260484:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788725936.260501:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788725936.260505:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788725935 00002000:00010000:1.0:1788725936.260507:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788725935 00002000:00010000:1.0:1788725936.260510:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788725935 00002000:00010000:1.0:1788725936.260522:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788725936.260529:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.260544:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.260571:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d371f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dda expref: 9 pid: 8716 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.260783:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788725936.260788:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788725936.260795:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.260806:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725936.260885:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725936.260941:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770433024:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 473us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725936.260949:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:0.0:1788725936.265786:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.265806:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.265837:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.265866:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.266113:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.266180:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725936.266185:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.266195:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.266216:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.266225:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdc72606/0xa13c582691d37245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725936.266382:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770432768:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 42345us (42606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.266394:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788725936.283481:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725936.283573:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770433280 00000100:00100000:3.0:1788725936.283583:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770433280 00000100:00100000:3.0:1788725936.283638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788725936.283649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+22:11149:x1875614770433280:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:3.0:1788725936.283706:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6df6 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788725936.283918:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788725936.283962:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788725936.284322:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788725936.284360:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.284384:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 26 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.284393:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.284436:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 26 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.284450:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 26 pid: 11950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725936.284464:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791495552:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725936.284556:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282203600 going to sleep for 11 seconds 00000100:00100000:3.0:1788725936.288636:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791495552:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725936.288665:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725936.288798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.288980:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770433408 00000100:00100000:0.0:1788725936.288987:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770433408 00010000:00010000:0.0:1788725936.289023:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 27 pid: 11950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725936.289084:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788725936.289094:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+27:2396:x1875614770433408:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725936.289108:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725936.289146:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 27 pid: 11950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289159:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 27 pid: 11950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289180:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d371dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dcc expref: 27 pid: 11950 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289194:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:0.0:1788725936.289199:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289208:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289215:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.289236:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725936.289279:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+26:2396:x1875614770433408:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 187us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.289286:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00010000:00010000:3.0:1788725936.289668:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.289677:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788725936.289777:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788725936.289885:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788725936.289969:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791495680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788725936.290027:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725936.290155:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282203540 going to sleep for 11 seconds 00000100:00100000:2.0:1788725936.290216:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791495680 00000100:00100000:2.0:1788725936.290221:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791495680 00000100:00100000:2.0:1788725936.290264:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788725936.290273:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791495680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788725936.290363:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791495680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725936.290370:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788725936.291219:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791495680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788725936.291401:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788725936.291456:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791495808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788725936.291493:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725936.291527:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282203480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725936.291639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791495808 00000100:00100000:2.0:1788725936.291645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791495808 00000100:00100000:2.0:1788725936.291688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788725936.291698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791495808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788725936.291813:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1875614791495808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (319us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788725936.291820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788725936.291909:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791495808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788725936.291945:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788725936.291975:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.291985:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.291992:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.291999:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725936.292002:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.292009:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.292023:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:3.0:1788725936.292026:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788725936.292031:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725936.292237:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3724c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788725936.292326:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788725936.292397:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788725936.292409:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381448291734ns, next at 382448289032ns, rc = 0 00000001:00080000:3.0:1788725936.292416:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788725936.292439:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe900) 00010000:00010000:3.0:1788725936.292442:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788725936.292448:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37237 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6df6 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725936.292539:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+29:11149:x1875614770433280:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 8893us (9067us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788725936.292547:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000020:00080000:3.0:1788725936.292551:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788725936.299377:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.300148:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770433536 00000100:00100000:0.0:1788725936.300173:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770433536 00000100:00100000:0.0:1788725936.300237:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788725936.300249:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+29:11149:x1875614770433536:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725936.300274:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.300296:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37253 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6dfd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.300352:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dfd expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.300377:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dfd expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.300397:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725936.300400:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725936.300403:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788725936.300456:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+30:11149:x1875614770433536:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 208us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725936.300464:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1788725936.310447:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.310552:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770433792 00000100:00100000:2.0:1788725936.310561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770433792 00000100:00100000:2.0:1788725936.310618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788725936.310630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:11149:x1875614770433792:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725936.310853:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+31:11149:x1875614770433792:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 225us (413us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788725936.310872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788725936.497815:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725936.497911:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770434048 00000100:00100000:0.0:1788725936.497921:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770434048 00000100:00100000:0.0:1788725936.497981:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788725936.497991:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+31:11159:x1875614770434048:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725936.498015:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725936.498035:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d3725a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e04 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725936.498179:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788725936.498296:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d3725a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e04 expref: 33 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.498308:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725936.498311:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725936.498316:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d3725a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e04 expref: 33 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725936.498328:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9800, rc 0) 00000100:00100000:0.0:1788725936.498384:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+32:11159:x1875614770434048:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 395us (578us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788725936.498391:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788725936.533238:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.533487:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770434176 00000100:00100000:2.0:1788725936.533496:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770434176 00000100:00100000:2.0:1788725936.533562:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788725936.533581:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+32:11159:x1875614770434176:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788725936.533651:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533668:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533693:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533706:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533713:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533719:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533795:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533804:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533811:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725936.533857:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533870:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533877:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533884:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533900:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.533904:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533912:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533925:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725936.533928:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725936.533933:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533939:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533954:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533961:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533967:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533972:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.533975:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533981:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.533998:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:2.0:1788725936.534001:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725936.534004:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534009:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3726f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534019:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534025:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534030:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534035:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.534038:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534312:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534321:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725936.534324:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725936.534327:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.534332:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725936.534427:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+32:11159:x1875614770434176:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 847us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725936.534436:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788725936.544501:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.547184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770434432 00000100:00100000:2.0:1788725936.547200:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770434432 00000100:00100000:2.0:1788725936.547339:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788725936.547350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+32:11159:x1875614770434432:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725936.547646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+33:11159:x1875614770434432:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 296us (3152us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788725936.547655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788725936.670333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.670435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770434688 00000100:00100000:2.0:1788725936.670444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770434688 00000100:00100000:2.0:1788725936.670520:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788725936.670531:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+33:11162:x1875614770434688:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725936.670555:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725936.670586:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d3727d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670662:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670676:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670688:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670719:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670728:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670736:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670838:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670847:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670854:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725936.670863:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788725936.670934:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670942:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670948:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670953:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.670957:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670975:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.670988:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725936.670991:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725936.670995:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671001:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37284 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671017:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671022:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671028:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671033:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.671036:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671054:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671062:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:2.0:1788725936.671064:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725936.671067:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671084:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3728b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671187:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d3727d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671202:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.671210:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725936.671213:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725936.671215:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659000, rc 0) 00000100:00100000:2.0:1788725936.671268:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+35:11162:x1875614770434688:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 739us (944us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788725936.671276:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788725936.685957:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725936.687814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770434816 00000100:00100000:2.0:1788725936.687828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770434816 00000100:00100000:2.0:1788725936.687943:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788725936.687954:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+35:11162:x1875614770434816:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788725936.688018:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688033:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688044:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688095:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688102:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688108:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688113:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725936.688134:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688141:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688153:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725936.688156:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788725936.688161:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725936.688167:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725936.688246:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+35:11162:x1875614770434816:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 293us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725936.688253:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788725936.704026:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725936.704140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770435072 00000100:00100000:3.0:1788725936.704150:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770435072 00000100:00100000:3.0:1788725936.704207:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788725936.704218:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+35:11162:x1875614770435072:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725936.704451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+36:11162:x1875614770435072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 234us (433us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788725936.704458:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:3.0:1788725937.019337:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725937.219775:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.219871:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770435328 00000100:00100000:2.0:1788725937.219881:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770435328 00000100:00100000:2.0:1788725937.219958:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788725937.219983:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+36:11193:x1875614770435328:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788725937.220008:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725937.220027:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e12 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.220161:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.220176:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.220187:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725937.220198:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788725937.220318:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e12 expref: 39 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.220335:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e12 expref: 38 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.220343:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.220346:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725937.220350:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725937.220632:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+38:11193:x1875614770435328:12345-192.168.203.12@tcp:101:cat.0 Request processed in 651us (865us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788725937.220640:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00080000:0.0:1788725937.220723:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725937.234814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725937.234869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.234955:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770435456 00000100:00100000:2.0:1788725937.234964:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770435456 00000100:00100000:2.0:1788725937.235052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788725937.235063:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+38:2395:x1875614770435456:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725937.235077:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725937.235100:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e12 expref: 38 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.235146:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.235151:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725937.235211:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+37:2395:x1875614770435456:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725937.235218:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788725937.235608:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770435712 00000100:00100000:3.0:1788725937.235613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770435712 00000100:00100000:3.0:1788725937.235648:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788725937.235665:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:11193:x1875614770435712:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1788725937.235850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:11193:x1875614770435712:12345-192.168.203.12@tcp:35:cat.0 Request processed in 187us (979us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788725937.235858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788725937.343262:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725937.343365:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770435968 00000100:00100000:0.0:1788725937.343374:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770435968 00000100:00100000:0.0:1788725937.343436:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788725937.343447:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+38:11199:x1875614770435968:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788725937.343482:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725937.343485:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788725937.343522:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6de8 expref: 38 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343540:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725937.343544:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725937.343576:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d372bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e19 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343689:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343702:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343710:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343740:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.343753:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 38 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725937.343765:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791495936:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725937.343861:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283454780 going to sleep for 11 seconds 00000100:00100000:0.0:1788725937.350697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725937.351186:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436096 00000100:00100000:1.0:1788725937.351200:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436096 00010000:00010000:1.0:1788725937.351244:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 39 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725937.351308:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788725937.351318:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+39:2396:x1875614770436096:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725937.351346:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725937.351352:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 39 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725937.351367:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 39 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725937.351389:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:1.0:1788725937.351394:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725937.351403:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725937.351411:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725937.351430:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725937.351501:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+39:2396:x1875614770436096:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 183us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725937.351517:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00010000:00010000:2.0:1788725937.352164:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e0b expref: 38 pid: 6512 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725937.352185:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791495936:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725937.352205:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.352214:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.352220:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725937.352237:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788725937.352394:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d372bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 39 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.352424:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 38 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.352431:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.352434:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788725937.352437:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8200, rc 0) 00000100:00100000:2.0:1788725937.352483:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+38:11199:x1875614770435968:12345-192.168.203.12@tcp:101:dd.0 Request processed in 9038us (9232us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788725937.352490:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788725937.367226:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.367432:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436224 00000100:00100000:2.0:1788725937.367442:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436224 00000100:00100000:2.0:1788725937.367500:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788725937.367520:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+38:11199:x1875614770436224:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788725937.367544:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725937.367574:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d372d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e20 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367610:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367624:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367634:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367746:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d372d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367774:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.367782:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.367786:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788725937.367790:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725937.367850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+39:11199:x1875614770436224:12345-192.168.203.12@tcp:101:dd.0 Request processed in 332us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725937.367856:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788725937.371005:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725937.372452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436480 00000100:00100000:3.0:1788725937.372473:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436480 00000100:00100000:3.0:1788725937.372540:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788725937.372550:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+39:11199:x1875614770436480:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788725937.372751:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725937.372767:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725937.372778:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788725937.372831:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788725937.372850:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068d73021 reply state 00000000b0df2d7d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725937.372861:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725937.372868:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725937.372871:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788725937.372874:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788725937.372962:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+42:11199:x1875614770436480:12345-192.168.203.12@tcp:36:dd.0 Request processed in 413us (1966us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788725937.372978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:3.0:1788725937.372990:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788725937.579013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.579264:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436608 00000100:00100000:2.0:1788725937.579277:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436608 00000100:00100000:2.0:1788725937.579378:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788725937.579392:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+42:11213:x1875614770436608:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1788725937.579425:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725937.579453:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d372e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e27 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579560:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579577:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579591:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579603:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579629:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579638:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579736:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579749:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 43 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579757:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579799:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 43 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.579814:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 43 pid: 11950 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725937.579831:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791496064:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725937.579955:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725937.583715:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791496064:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725937.583761:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725937.585045:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.585554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436864 00000100:00100000:2.0:1788725937.585591:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436864 00000100:00100000:2.0:1788725937.585671:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788725937.585684:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+44:6166:x1875614770436864:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788725937.586661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+45:6166:x1875614770436864:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 973us (1625us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788725937.586676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788725937.590801:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.591074:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770436992 00000100:00100000:2.0:1788725937.591087:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770436992 00010000:00010000:2.0:1788725937.591287:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 45 pid: 11950 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725937.591341:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788725937.591363:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+45:2395:x1875614770436992:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725937.591384:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725937.591393:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 45 pid: 11950 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591409:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 45 pid: 11950 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591437:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d372c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e19 expref: 45 pid: 11950 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591457:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.591463:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591626:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591637:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.591777:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725937.591855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+44:2395:x1875614770436992:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 503us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725937.591864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00010000:00010000:0.0:1788725937.593705:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593726:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725937.593804:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788725937.593829:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725937.593885:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593904:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593916:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593923:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593930:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.593937:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725937.593942:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594013:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594089:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725937.594093:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725937.594098:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594105:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d372ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594242:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594262:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594268:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594273:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725937.594277:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594284:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594294:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:0.0:1788725937.594297:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725937.594300:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594307:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d372f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594360:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d372e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e27 expref: 44 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594387:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e27 expref: 43 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725937.594395:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725937.594397:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725937.594408:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658800, rc 0) 00000100:00100000:0.0:1788725937.594651:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+43:11213:x1875614770436608:12345-192.168.203.12@tcp:101:stat.0 Request processed in 15260us (15651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725937.594661:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:0.0:1788725937.725674:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.725795:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770437248 00000100:00100000:2.0:1788725937.725809:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770437248 00000100:00100000:2.0:1788725937.725889:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788725937.725903:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+43:11219:x1875614770437248:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:2.0:1788725937.725981:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725937.726017:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d372fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e27 expref: 43 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.726055:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.726061:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725937.726346:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.726365:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.726376:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725937.726451:0:9522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788725937.726475:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a121a4b reply state 00000000f308faaa transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.726489:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.726496:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.726499:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725937.726516:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725937.726662:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+45:11219:x1875614770437248:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 760us (1003us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788725937.726670:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000020:00080000:2.0:1788725937.726676:0:9522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788725937.789444:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791496192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725937.789560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725937.789935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791496192 00000100:00100000:0.0:1788725937.789946:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791496192 00000100:00100000:0.0:1788725937.790011:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788725937.790023:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791496192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725937.790100:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788725937.790198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791496192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725937.790207:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788725937.790542:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791496192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725937.979919:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725937.980373:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770437376 00000100:00100000:2.0:1788725937.980387:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770437376 00000100:00100000:2.0:1788725937.980466:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788725937.980479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+45:11233:x1875614770437376:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1788725937.980523:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725937.980548:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37309 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e2e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980696:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980715:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980730:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980769:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980778:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980785:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980902:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980913:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.980920:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725937.980973:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788725937.980978:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725937.981332:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981348:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981358:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981365:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981384:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981390:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725937.981395:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981403:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981417:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725937.981420:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725937.981426:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981433:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37310 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981451:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981458:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981465:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981470:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725937.981473:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981489:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981497:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:2.0:1788725937.981499:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725937.981516:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981523:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981558:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37309 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981572:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725937.981580:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725937.981583:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725937.981585:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725937.981738:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+46:11233:x1875614770437376:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1260us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725937.981748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:1.0:1788725938.052403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725938.067054:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725938.067264:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770437632 00000100:00100000:0.0:1788725938.067277:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770437632 00000100:00100000:0.0:1788725938.067802:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:0.0:1788725938.067815:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+46:11243:x1875614770437632:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725938.067843:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725938.067869:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e35 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725938.068010:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788725938.068186:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37325 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e35 expref: 48 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.068204:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725938.068207:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725938.068223:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e35 expref: 48 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.068240:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9a00, rc 0) 00000100:00100000:0.0:1788725938.068319:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+47:11243:x1875614770437632:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 507us (1280us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788725938.068327:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788725938.078054:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.078162:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770437888 00000100:00100000:2.0:1788725938.078174:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770437888 00000100:00100000:2.0:1788725938.078241:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788725938.078252:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+47:11243:x1875614770437888:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725938.078592:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+48:11243:x1875614770437888:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 337us (560us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788725938.078601:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788725938.161275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725938.161430:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770438144 00000100:00100000:3.0:1788725938.161443:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770438144 00000100:00100000:3.0:1788725938.161569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788725938.161582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+48:11249:x1875614770438144:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788725938.161615:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725938.161641:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37333 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e3c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.161856:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.161875:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.161885:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.161928:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.161944:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 49 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725938.161959:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791496320:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725938.163542:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282203240 going to sleep for 11 seconds 00000100:00100000:3.0:1788725938.169807:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791496320:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725938.169852:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725938.170869:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725938.171566:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770438272 00000100:00100000:0.0:1788725938.171579:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770438272 00010000:00010000:0.0:1788725938.171635:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 50 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725938.171686:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:0.0:1788725938.171698:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab293050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+50:2396:x1875614770438272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725938.171715:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725938.171723:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 50 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171752:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 50 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171800:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d3731e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e2e expref: 50 pid: 6510 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171825:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725938.171831:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171866:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171876:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.171920:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725938.171996:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab293050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+49:2396:x1875614770438272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 299us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.172003:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00010000:00010000:3.0:1788725938.173866:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.173894:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725938.173924:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788725938.183532:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37333 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.183572:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 49 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.183584:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725938.183588:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788725938.183592:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045800, rc 0) 00000100:00100000:3.0:1788725938.183682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+49:11249:x1875614770438144:12345-192.168.203.12@tcp:101:bash.0 Request processed in 22101us (22421us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788725938.183692:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788725938.190715:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.190836:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770438528 00000100:00100000:2.0:1788725938.190850:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770438528 00000100:00100000:2.0:1788725938.190940:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:2.0:1788725938.190953:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+49:11249:x1875614770438528:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788725938.191346:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.191383:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.191397:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725938.191453:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788725938.191477:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4ca6ec6 reply state 0000000094f3659e transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.191492:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.191511:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.191514:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725938.191519:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725938.191627:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+52:11249:x1875614770438528:12345-192.168.203.12@tcp:36:bash.0 Request processed in 675us (926us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788725938.191634:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000020:00080000:2.0:1788725938.191662:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788725938.214474:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.217778:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770438656 00000100:00100000:2.0:1788725938.217801:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770438656 00000100:00100000:2.0:1788725938.217916:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788725938.217931:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+52:11249:x1875614770438656:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725938.217984:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725938.218015:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3734f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e43 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.218820:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.218845:0:9522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.218856:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.218907:0:9522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.218927:0:9522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 53 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725938.218943:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791496448:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725938.219104:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725938.225311:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791496448:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725938.225362:0:9522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725938.238194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.239391:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770438784 00000100:00100000:2.0:1788725938.239408:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770438784 00010000:00010000:2.0:1788725938.239469:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 54 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725938.239528:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788725938.239541:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+54:2395:x1875614770438784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725938.239559:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725938.239567:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 54 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239584:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 54 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239612:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3733a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e3c expref: 54 pid: 6512 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239636:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.239642:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239654:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239664:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.239709:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725938.239807:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+53:2395:x1875614770438784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 268us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.239815:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00010000:00010000:3.0:1788725938.241933:0:9522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.241958:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725938.245693:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788725938.245708:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725938.245752:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.245815:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3734f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e43 expref: 53 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.245846:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e43 expref: 52 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.245857:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.245861:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725938.245865:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659600, rc 0) 00000100:00100000:2.0:1788725938.245969:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+52:11249:x1875614770438656:12345-192.168.203.12@tcp:101:bash.0 Request processed in 28039us (31507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.245978:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788725938.255509:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.255597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439040 00000100:00100000:2.0:1788725938.255618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439040 00000100:00100000:2.0:1788725938.255689:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:2.0:1788725938.255698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+52:11249:x1875614770439040:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788725938.255977:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+53:11249:x1875614770439040:12345-192.168.203.12@tcp:35:bash.0 Request processed in 278us (492us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788725938.255985:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000001:00080000:2.0:1788725938.278820:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967346 is committed 00000004:00080000:2.0:1788725938.278879:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788725938.278895:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b1282203540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788725938.278899:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13852cee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b12822033c0 00000020:00080000:2.0:1788725938.278902:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13852ce900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b13af8f2800 00000100:00100000:0.0:1788725938.279104:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791496576:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788725938.279172:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725938.279193:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725938.279196:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279209:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279216:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6afc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279224:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279232:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279256:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b1382afe600) 00010000:00010000:3.0:1788725938.279260:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279266:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279274:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6afc00/0xa13c582691d3718f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279304:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279310:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279316:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279337:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6ae200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279340:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279346:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279355:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725938.279357:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279360:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279367:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6ae200/0xa13c582691d37196 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279383:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279390:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279396:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279402:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279405:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279410:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279430:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1382afec00) 00010000:00010000:3.0:1788725938.279432:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279435:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279442:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d371d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279458:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279465:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279471:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279476:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279479:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279485:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279492:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725938.279494:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279496:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279514:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d372df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279547:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279553:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279559:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279574:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279577:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279584:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279593:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725938.279595:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279598:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279604:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37302 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279614:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279621:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279627:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279640:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.279643:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279650:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279658:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725938.279660:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.279662:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.279668:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37348 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725938.279705:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791496576 00000100:00100000:3.0:1788725938.279715:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791496576 00000100:00100000:3.0:1788725938.279815:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788725938.279827:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791496576:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788725938.280111:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788725938.280361:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788725938.280404:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9dcaaf, atime: 0x6a9dcaaf, ctime: 0x6a9dcaaf, blocks: 0x8 00010000:00010000:3.0:1788725938.280414:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.280432:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1788725938.280437:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725938.280445:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.280479:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.280489:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.280497:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.280540:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788725938.280601:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788725938.281197:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791496576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1275us (1910us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788725938.281209:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:1.0:1788725938.281466:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:0.0:1788725938.281743:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b13832b9c00/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788725938.281753:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791496576:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788725938.282147:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.282162:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788725938.282167:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.282178:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.282200:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.282209:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047fd15ca/0xa13c582691d3735d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.282338:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725938.282343:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725938.282346:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788725938.282763:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788725938.300483:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725938.300514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791496704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725938.300583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725938.300842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791496832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725938.300882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725938.301061:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791496704 00000100:00100000:2.0:1788725938.301069:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791496704 00000100:00100000:2.0:1788725938.301137:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791496832 00000100:00100000:2.0:1788725938.301141:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791496832 00000100:00100000:2.0:1788725938.301170:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788725938.301179:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791496704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725938.301217:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788725938.301262:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791496704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.301269:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788725938.301285:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788725938.301291:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791496832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725938.301300:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788725938.301340:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791496832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.301346:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788725938.301362:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725938.301438:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791496832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725938.301471:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791496704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725938.368719:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.368758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.368788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.368821:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.368848:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.368893:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439296 00000100:00100000:1.0:1788725938.368901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439296 00000100:00100000:0.0:1788725938.369222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439168 00000100:00100000:0.0:1788725938.369227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439168 00000100:00100000:0.0:1788725938.369274:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 378 00000100:00100000:0.0:1788725938.369285:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770439168:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725938.369365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770439168:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 81us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.369373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 378 00000100:00100000:0.0:1788725938.369419:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439552 00000100:00100000:0.0:1788725938.369423:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439552 00000100:00100000:0.0:1788725938.369455:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439680 00000100:00100000:0.0:1788725938.369469:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439680 00000100:00100000:0.0:1788725938.369490:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:0.0:1788725938.369524:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770439552:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725938.369557:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770439552:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 35us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.369563:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 270 00000100:00100000:0.0:1788725938.369576:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00100000:0.0:1788725938.369583:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770439680:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725938.369618:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770439680:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.369626:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 271 00000100:00080000:2.0:1788725938.370446:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725938.370451:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725938.370476:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439424 00000100:00100000:2.0:1788725938.370482:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439424 00000100:00100000:2.0:1788725938.370543:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:2.0:1788725938.370552:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770439424:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725938.370594:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770439424:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 43us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.370600:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:1.0:1788725938.370827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00100000:1.0:1788725938.370834:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770439296:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725938.370863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770439296:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725938.370868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 272 00000100:00080000:0.0:1788725938.373346:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725938.373360:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725938.397810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.397933:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770439936 00000100:00100000:2.0:1788725938.397944:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770439936 00000100:00100000:2.0:1788725938.398005:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:2.0:1788725938.398029:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+12:11259:x1875614770439936:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725938.398053:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725938.398074:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e4a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725938.398208:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788725938.398306:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37364 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e4a expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.398333:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:2.0:1788725938.398336:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788725938.398341:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e4a expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.398354:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658e00, rc 0) 00000100:00100000:2.0:1788725938.398403:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+13:11259:x1875614770439936:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 378us (604us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788725938.398411:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:1.0:1788725938.407601:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.408424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770440064 00000100:00100000:2.0:1788725938.408440:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770440064 00000100:00100000:2.0:1788725938.408528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:2.0:1788725938.408542:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11259:x1875614770440064:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788725938.408647:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.408667:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.408703:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.408725:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.408733:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.408739:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.409664:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.409680:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.409689:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725938.410241:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410260:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410267:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410274:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410461:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725938.410467:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410475:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410626:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725938.410630:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725938.410635:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410641:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410659:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410665:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410672:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410677:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725938.410680:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410685:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410704:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b12819cbe00) 00010000:00010000:2.0:1788725938.410707:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725938.410711:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410717:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d37379 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410738:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410743:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.410749:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.412071:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725938.412077:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.412085:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.412108:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.412111:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725938.412115:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.412142:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725938.412293:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11259:x1875614770440064:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 3748us (4702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.412306:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788725938.422997:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.424657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770440320 00000100:00100000:2.0:1788725938.424675:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770440320 00000100:00100000:2.0:1788725938.424883:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788725938.424896:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11259:x1875614770440320:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725938.425547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+14:11259:x1875614770440320:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 650us (2561us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788725938.425557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788725938.575384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.575515:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770440576 00000100:00100000:2.0:1788725938.575528:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770440576 00000100:00100000:2.0:1788725938.575606:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788725938.575619:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+14:11262:x1875614770440576:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725938.575651:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725938.575675:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37387 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e51 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575794:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575811:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575824:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575863:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575872:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.575880:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.576017:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3739c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.576028:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3739c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.576036:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3739c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725938.576047:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788725938.577839:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577859:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577890:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577897:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.577902:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577910:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577929:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725938.577932:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.577937:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577943:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d3738e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577963:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577969:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577974:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577979:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725938.577981:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.577996:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.578004:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b12819cbe00) 00010000:00010000:3.0:1788725938.578006:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725938.578008:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.578014:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.578084:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37387 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e51 expref: 17 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.578101:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3739c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e51 expref: 16 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.578108:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725938.578111:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725938.578113:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658600, rc 0) 00000100:00100000:3.0:1788725938.578293:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+16:11262:x1875614770440576:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2675us (2922us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788725938.578827:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788725938.584084:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725938.584170:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725938.584273:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770440704 00000100:00100000:0.0:1788725938.584286:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770440704 00000100:00100000:2.0:1788725938.584620:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770440832 00000100:00100000:2.0:1788725938.584625:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770440832 00000100:00100000:2.0:1788725938.584715:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788725938.584729:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:2396:x1875614770440832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725938.584759:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725938.584790:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3739c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e51 expref: 17 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.584813:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.584819:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725938.584899:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+16:2396:x1875614770440832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 173us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.584908:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:0.0:1788725938.586198:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1788725938.586223:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+15:11262:x1875614770440704:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788725938.586312:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586333:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586347:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586391:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586432:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586439:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586445:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725938.586450:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586459:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586472:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725938.586475:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725938.586479:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.586485:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725938.586586:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+15:11262:x1875614770440704:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 374us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.586595:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:1.0:1788725938.603228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725938.608647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770441088 00000100:00100000:3.0:1788725938.608668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770441088 00000100:00100000:3.0:1788725938.608783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788725938.608796:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+15:11262:x1875614770441088:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725938.609159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+16:11262:x1875614770441088:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 364us (5945us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788725938.609167:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788725938.738213:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.740425:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770441344 00000100:00100000:2.0:1788725938.740444:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770441344 00000100:00100000:2.0:1788725938.740552:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788725938.740563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+16:11280:x1875614770441344:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788725938.740594:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725938.740619:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d373b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e58 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.741164:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d373b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.741183:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d373b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.741200:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d373b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725938.741215:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788725938.741990:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d373b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e58 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.742014:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d373b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e58 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.742024:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.742027:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788725938.742045:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725938.744006:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:11280:x1875614770441344:12345-192.168.203.12@tcp:101:cat.0 Request processed in 3426us (5787us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788725938.744021:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:1.0:1788725938.774208:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725938.774527:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770441472 00000100:00100000:3.0:1788725938.774540:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770441472 00000100:00100000:3.0:1788725938.774620:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1788725938.774633:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:11281:x1875614770441472:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725938.774665:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725938.774691:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d373c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e5f expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774786:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774802:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774814:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725938.774876:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788725938.774880:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725938.774903:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774933:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d373c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e5f expref: 20 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774957:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e5f expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725938.774985:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725938.774988:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788725938.774992:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045000, rc 0) 00000100:00100000:3.0:1788725938.775072:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:11281:x1875614770441472:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 441us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725938.775079:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788725938.788010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725938.788174:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770441856 00000100:00100000:3.0:1788725938.788186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770441856 00000100:00100000:3.0:1788725938.788257:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788725938.788268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+19:11281:x1875614770441856:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725938.788679:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:11281:x1875614770441856:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 411us (683us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788725938.788688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788725938.793637:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.797385:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770441984 00000100:00100000:2.0:1788725938.797407:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770441984 00000100:00100000:2.0:1788725938.797532:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788725938.797545:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:11281:x1875614770441984:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:2.0:1788725938.797568:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788725938.797602:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d37356 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e43 expref: 20 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.797633:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d373b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e58 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.797647:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37253 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dfd expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725938.797660:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725938.797665:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725938.797768:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:11281:x1875614770441984:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 226us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725938.797776:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788725938.807429:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725938.807614:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442112 00000100:00100000:0.0:1788725938.807627:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442112 00000100:00100000:0.0:1788725938.807715:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788725938.807728:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:11281:x1875614770442112:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:0.0:1788725938.807903:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.807925:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.807939:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788725938.808318:0:9522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788725938.808478:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788725938.808583:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788725938.808698:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:11281:x1875614770442112:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 970us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.808709:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788725938.842479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725938.842802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442240 00000100:00100000:2.0:1788725938.842816:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442240 00000100:00100000:0.0:1788725938.843025:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788725938.843044:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:11283:x1875614770442240:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725938.843073:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725938.843101:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d373db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e66 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843353:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843371:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843384:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843424:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843432:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843439:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843563:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843579:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843588:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725938.843645:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788725938.843650:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725938.843674:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843689:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843698:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843706:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843723:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843730:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725938.843734:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843743:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843759:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725938.843763:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725938.843769:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843776:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d373e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843791:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843797:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843803:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843808:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725938.843811:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843827:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843836:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1391f3ef00) 00010000:00010000:0.0:1788725938.843838:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725938.843841:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843848:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d373e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843888:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d373db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843903:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725938.843911:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725938.843914:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725938.843922:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8800, rc 0) 00000100:00100000:0.0:1788725938.844031:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:11283:x1875614770442240:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 993us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725938.844040:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00010000:00010000:3.0:1788725939.068421:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788725939.545656:0:14201:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725939.545672:0:14201:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725939.545703:0:14201:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788725939.545722:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788725939.771447:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725939.771461:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725939.771523:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788725939.771533:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725939.771735:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8ce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791496960:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788725939.771869:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654780 going to sleep for 11 seconds 00000100:00100000:3.0:1788725939.777360:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725939.777459:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442368 00000100:00100000:2.0:1788725939.777472:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442368 00000100:00100000:2.0:1788725939.777578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:2.0:1788725939.777592:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770442368:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1788725939.777602:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788725939.777633:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788725939.777890:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770442368:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 301us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.777898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788725939.779421:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8ce300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791496960:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788725939.788577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725939.788957:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442496 00000100:00100000:1.0:1788725939.788971:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442496 00000100:00100000:1.0:1788725939.789066:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788725939.789078:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:11295:x1875614770442496:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788725939.789200:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789221:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789236:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789396:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789418:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789449:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789484:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789641:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789650:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725939.789698:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788725939.789702:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725939.789714:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789773:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789781:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789788:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789794:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725939.789798:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789805:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789823:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:1.0:1788725939.789826:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725939.789830:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789837:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d373f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789852:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789857:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789863:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789869:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fe00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725939.789872:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789877:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789883:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9b1283234800) 00010000:00010000:1.0:1788725939.789885:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725939.789888:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789893:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d373fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789915:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789922:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789928:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789932:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725939.789935:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789941:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.789947:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:1.0:1788725939.790000:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725939.790004:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.790010:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37405 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725939.790196:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:11295:x1875614770442496:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1116us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725939.790207:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788725939.794070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.795592:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442752 00000100:00100000:0.0:1788725939.795613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442752 00000100:00100000:0.0:1788725939.795707:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788725939.795723:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:11295:x1875614770442752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725939.795765:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725939.795793:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d3740c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e6d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.795944:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.795962:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.795976:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725939.795990:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788725939.799039:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799060:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799069:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799076:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725939.799082:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799099:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799143:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:0.0:1788725939.799160:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725939.799166:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799172:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37413 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799249:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d3740c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e6d expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799260:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725939.799263:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725939.799266:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d3740c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e6d expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.799279:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8000, rc 0) 00000100:00100000:0.0:1788725939.799444:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770442752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3725us (5380us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788725939.799455:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:2.0:1788725939.807999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725939.808471:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770442880 00000100:00100000:3.0:1788725939.808487:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770442880 00000100:00100000:3.0:1788725939.808592:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788725939.808607:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770442880:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788725939.808657:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788725939.808814:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770442880:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 210us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725939.808822:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1788725939.818236:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725939.820647:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770443136 00000100:00100000:1.0:1788725939.820661:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770443136 00000100:00100000:1.0:1788725939.820938:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788725939.820960:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770443136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788725939.820981:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725939.820984:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788725939.821009:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d373cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e5f expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821027:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:1.0:1788725939.821032:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725939.821046:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37421 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e74 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788725939.821453:0:9522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788725939.821605:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37428 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821619:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821629:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37428 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821679:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37421 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e74 expref: 21 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821693:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37428 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e74 expref: 20 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.821700:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1283234800) 00010000:00010000:1.0:1788725939.821703:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788725939.821712:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fe00, rc 0) 00000100:00100000:1.0:1788725939.821777:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+20:11295:x1875614770443136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 818us (3554us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788725939.821784:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788725939.825249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.825473:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770443392 00000100:00100000:0.0:1788725939.825499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770443392 00000100:00100000:0.0:1788725939.825584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788725939.825595:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:11295:x1875614770443392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788725939.825665:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725939.825696:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37428 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e74 expref: 20 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825735:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1283234800) 00010000:00010000:0.0:1788725939.825747:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725939.825775:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825789:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825799:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825813:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825820:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825826:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825878:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825895:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825901:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825908:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725939.825912:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825926:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825936:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725939.825939:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725939.825943:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825949:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37436 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825958:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825964:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825971:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825977:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725939.825980:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825986:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.825993:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6dd74e2c (ffff9b1391f3ef00) 00010000:00010000:0.0:1788725939.825996:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725939.825998:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.826012:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d3743d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6dd74e2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725939.826161:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770443392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 566us (921us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725939.826170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788725939.833218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.833321:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770443520 00000100:00100000:0.0:1788725939.833339:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770443520 00000100:00100000:0.0:1788725939.833396:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788725939.833407:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:11295:x1875614770443520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725939.833427:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725939.833450:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37444 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e7b expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833485:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833508:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833518:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833644:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37444 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 21 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833663:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 20 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725939.833684:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:0.0:1788725939.833687:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788725939.833691:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9e00, rc 0) 00000100:00100000:0.0:1788725939.833755:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+20:11295:x1875614770443520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 350us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725939.833763:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:2.0:1788725939.840084:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725939.840698:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770443776 00000100:00100000:3.0:1788725939.840710:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770443776 00000100:00100000:3.0:1788725939.840772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788725939.840783:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:11295:x1875614770443776:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788725939.840862:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.840879:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.840891:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788725939.841066:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788725939.841075:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384996957017ns, next at 385996954879ns, rc = 0 00000004:00010000:3.0:1788725939.841147:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034f0187a reply state 00000000296d3148 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.841161:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.841170:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:3.0:1788725939.841174:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788725939.841178:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788725939.841857:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:11295:x1875614770443776:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1070us (1774us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788725939.841866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788725939.844687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.844848:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770443904 00000100:00100000:0.0:1788725939.845080:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770443904 00000100:00100000:1.0:1788725939.845284:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788725939.845296:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:11295:x1875614770443904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788725939.845317:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725939.845335:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e82 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.845464:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 23 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.845481:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 23 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725939.845511:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:1.0:1788725939.846200:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725939.846205:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725939.846320:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+23:11295:x1875614770443904:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1024us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725939.846328:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:1.0:1788725939.851713:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725939.852890:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444032 00000100:00100000:2.0:1788725939.852911:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444032 00000100:00100000:2.0:1788725939.852966:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788725939.852975:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770444032:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788725939.853009:0:8716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1788725939.853052:0:8716:0:(genops.c:1385:class_connect()) connect: client 78ae299a-14d0-4856-aa24-442bf24804dd, cookie 0xa13c582691d37460 00002000:00100000:2.0:1788725939.853063:0:8716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 78ae299a-14d0-4856-aa24-442bf24804dd/ffff9b1385531000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788725939.853080:0:8716:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788725939.853192:0:8716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788725939.853223:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b1385536800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788725939.853288:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2394:x1875614770444032:12345-192.168.203.12@tcp:8:lhsmtool_posix.0 Request processed in 313us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.853296:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788725939.856569:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725939.856650:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444160 00000100:00100000:3.0:1788725939.856659:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444160 00000100:00100000:3.0:1788725939.856736:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788725939.856746:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:0:x1875614770444160:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788725939.856945:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788725939.866333:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788725939.866346:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000100:00100000:0.0:1788725939.866596:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:0:x1875614770444160:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 9846us (10030us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788725939.866607:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788725939.869733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725939.869810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444416 00000100:00100000:3.0:1788725939.869820:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444416 00000100:00100000:3.0:1788725939.869877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788725939.869888:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+23:11295:x1875614770444416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725939.870105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:11295:x1875614770444416:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 218us (380us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788725939.870112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788725939.880295:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.880350:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444672 00000100:00100000:0.0:1788725939.880361:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444672 00000100:00100000:0.0:1788725939.880424:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788725939.880435:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+24:11295:x1875614770444672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788725939.880576:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+24:11295:x1875614770444672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 142us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725939.880584:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788725939.894930:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725939.895012:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444800 00000100:00100000:3.0:1788725939.895022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444800 00000100:00100000:3.0:1788725939.895092:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1788725939.895102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:11295:x1875614770444800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725939.895155:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725939.895176:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37467 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e89 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.895246:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.895260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725939.895452:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725939.895580:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725939.895602:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.895633:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37467 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e89 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.895652:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e89 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.895661:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725939.895664:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788725939.895668:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:2.0:1788725939.895731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+25:11295:x1875614770444800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 631us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.895739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788725939.906244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725939.909454:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770444928 00000100:00100000:2.0:1788725939.909470:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770444928 00000100:00100000:2.0:1788725939.909612:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:2.0:1788725939.909622:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770444928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725939.909638:0:8716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725939.909657:0:8716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e90 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788725939.909683:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcab3, blocks: 0x0 00010000:00010000:2.0:1788725939.909715:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788725939.909719:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725939.909728:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 6 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.909747:0:8716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 6 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.909760:0:8716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658e00, rc 0) 00000100:00100000:2.0:1788725939.909827:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770444928:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 206us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.909834:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788725939.917479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.917686:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445184 00000100:00100000:0.0:1788725939.917695:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445184 00000100:00100000:0.0:1788725939.917761:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788725939.917772:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:11295:x1875614770445184:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788725939.917890:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:11295:x1875614770445184:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725939.917897:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788725939.934923:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725939.939453:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445312 00000100:00100000:2.0:1788725939.939468:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445312 00000100:00100000:2.0:1788725939.939605:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:2.0:1788725939.939615:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:11295:x1875614770445312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725939.939632:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725939.939648:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e97 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.939676:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.939685:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725939.939689:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725939.939694:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.939742:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.939756:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725939.939771:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791497088:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725939.939921:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788725939.957037:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791497088:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725939.957088:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.957110:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658800, rc 0) 00000100:00100000:2.0:1788725939.957467:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:11295:x1875614770445312:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 17850us (22550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.957477:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788725939.957914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725939.959588:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445440 00000100:00100000:2.0:1788725939.959601:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445440 00010000:00010000:2.0:1788725939.959643:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725939.959687:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788725939.959697:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770445440:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725939.959727:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725939.959750:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.959767:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.959790:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084180539/0xa13c582691d37475 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e90 expref: 7 pid: 8716 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.959808:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725939.959813:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725939.959822:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.959833:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725939.959870:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725939.959885:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10330:1875614791497216:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788725939.959948:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725939.978945:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725939.979375:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445568 00000100:00100000:0.0:1788725939.979385:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445568 00002000:00100000:0.0:1788725939.979430:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b1283633100 x1875614770445568/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:335/0 lens 504/0 e 0 to 0 dl 1788725950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788725939.979441:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283633100 with x1875614770445568 ext(0->8) 00002000:00010000:0.0:1788725939.979446:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283633100 00000100:00100000:0.0:1788725939.979477:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788725939.979504:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770445568:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788725939.992942:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770445568:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 13446us (13994us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788725939.992958:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:0.0:1788725939.992970:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9b1283633100 x1875614770445568/t4294967303(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:335/0 lens 504/448 e 0 to 0 dl 1788725950 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788725939.992981:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283633100 with x1875614770445568 ext(0->8) 00002000:00010000:0.0:1788725939.992986:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283633100 00000100:00100000:2.0:1788725939.996300:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10330:1875614791497216:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788725939.996326:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725939.996402:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770445440:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 36706us (38489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725939.996413:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788725940.002820:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.002919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445696 00000100:00100000:2.0:1788725940.002928:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445696 00000100:00100000:2.0:1788725940.003026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1788725940.003037:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+25:11295:x1875614770445696:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788725940.006614:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788725940.006629:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788725940.006679:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788725940.006895:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791497344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788725940.006964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725940.007098:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791497344 00000100:00100000:0.0:1788725940.007105:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791497344 00000100:00100000:0.0:1788725940.007197:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788725940.007208:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791497344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788725940.007330:0:8716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788725940.007340:0:8716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788725939 00002000:00010000:0.0:1788725940.007355:0:8716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788725940.007357:0:8716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788725939 -> 1788725939 00002000:00010000:0.0:1788725940.007359:0:8716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788725940.007405:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791497344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 199us (441us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788725940.007413:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788725940.007457:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b12833bf100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788725940.007463:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791497344:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788725940.007700:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1788725940.007826:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788725940.007838:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1788725940.008091:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008103:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008110:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008229:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725940.008235:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008244:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008261:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725940.008263:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788725940.008331:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.008395:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37452 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.008666:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:11295:x1875614770445696:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 5627us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725940.008675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1788725940.012593:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725940.012695:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770445824 00000100:00100000:0.0:1788725940.012706:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770445824 00000100:00100000:0.0:1788725940.012801:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788725940.012814:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770445824:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788725940.015704:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788725940.015717:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788725940.016012:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770445824:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 3196us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.016574:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788725940.019929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.020078:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446080 00000100:00100000:2.0:1788725940.020088:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446080 00000100:00100000:2.0:1788725940.020355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1788725940.020366:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+14:11295:x1875614770446080:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788725940.020415:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725940.020439:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3746e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e89 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.020457:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725940.020462:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725940.020506:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.020518:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.020527:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725940.020639:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000858db4b4 reply state 000000000b87d4cf transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.020651:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.020674:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725940.020676:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725940.020680:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725940.020776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+15:11295:x1875614770446080:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 411us (854us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788725940.020783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788725940.030242:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725940.030727:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446208 00000100:00100000:0.0:1788725940.030739:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446208 00000100:00100000:0.0:1788725940.030792:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788725940.030802:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770446208:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788725940.030965:0:8716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788725940.030968:0:8716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788725939 -> 1788725937 00002000:00010000:0.0:1788725940.030971:0:8716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788725935 00002000:00010000:0.0:1788725940.030973:0:8716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788725939 -> 1788725937 00002000:00010000:0.0:1788725940.030976:0:8716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788725940.031041:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770446208:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 240us (807us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788725940.031062:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788725940.046035:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.047070:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446464 00000100:00100000:2.0:1788725940.047080:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446464 00000100:00100000:2.0:1788725940.047185:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788725940.047196:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+15:11295:x1875614770446464:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788725940.047262:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.047289:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 15 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.047298:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.047332:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 15 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.047347:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 15 pid: 11950 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.047362:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791497472:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725940.047461:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725940.052384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.052610:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791497472:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725940.052634:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725940.052755:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446592 00000100:00100000:3.0:1788725940.052762:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446592 00010000:00010000:3.0:1788725940.052795:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 16 pid: 11950 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725940.052831:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788725940.052839:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+16:2395:x1875614770446592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725940.052851:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725940.052858:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 16 pid: 11950 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052869:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 16 pid: 11950 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052889:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3744b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e7b expref: 16 pid: 11950 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052904:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:3.0:1788725940.052909:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052918:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052938:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.052963:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725940.053009:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:2395:x1875614770446592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 170us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725940.053016:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00010000:00010000:2.0:1788725940.053105:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053113:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053187:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053194:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053202:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053208:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725940.053212:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053219:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053229:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725940.053231:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788725940.053235:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.053241:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d3748a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.053301:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+14:11295:x1875614770446464:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 6107us (7291us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788725940.053309:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:3.0:1788725940.057420:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.057504:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446720 00000100:00100000:2.0:1788725940.057513:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446720 00000100:00100000:2.0:1788725940.057572:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:2.0:1788725940.057581:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770446720:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788725940.057624:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.057644:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.057652:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725940.057656:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725940.057659:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.057692:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.057706:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.057719:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791497600:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725940.057811:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725940.074840:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.075066:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770446848 00000100:00100000:2.0:1788725940.075077:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770446848 00010000:00010000:2.0:1788725940.075149:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.075192:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788725940.075202:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770446848:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725940.075228:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725940.075249:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.075263:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 8 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.075288:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725940.075293:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725940.075299:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.075309:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.075330:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725940.075388:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770446848:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 188us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725940.075395:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00010000:00010000:0.0:1788725940.077193:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaa196ed/0xa13c582691d3747c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e97 expref: 7 pid: 8426 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725940.077218:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791497600:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725940.077241:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077252:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077259:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077285:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077293:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077302:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077309:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725940.077313:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077333:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077418:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.077426:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa43ef65/0xa13c582691d37491 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725940.077674:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770446720:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 20092us (20262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.077684:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788725940.084563:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725940.084740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770447104 00000100:00100000:2.0:1788725940.084750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770447104 00000100:00100000:2.0:1788725940.084811:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:2.0:1788725940.084822:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:11295:x1875614770447104:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788725940.084896:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.084912:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.084922:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.084959:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.085408:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 14 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.085427:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791497728:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725940.086101:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788725940.091876:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725940.098583:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725940.098785:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770447232 00000100:00100000:3.0:1788725940.098795:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770447232 00010000:00010000:3.0:1788725940.098836:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725940.098878:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788725940.098889:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:2395:x1875614770447232:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725940.098903:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725940.098910:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.098923:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 15 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.098945:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725940.098950:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.098979:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.098986:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.099007:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725940.099077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab290850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:2395:x1875614770447232:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 189us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725940.099085:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00010000:00010000:0.0:1788725940.099368:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d372d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e20 expref: 14 pid: 6511 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725940.099387:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be8a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791497728:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725940.099407:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099417:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099423:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099610:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099629:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 14 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099638:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099685:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 14 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.099699:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 14 pid: 9522 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725940.099713:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791497856:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725940.099767:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725940.106495:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791497856:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725940.106523:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.110098:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725940.113170:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770447360 00000100:00100000:3.0:1788725940.113185:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770447360 00010000:00010000:3.0:1788725940.113230:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 15 pid: 9522 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725940.113278:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788725940.113287:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+15:2396:x1875614770447360:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725940.113301:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725940.113308:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 15 pid: 9522 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113322:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 15 pid: 9522 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113781:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37459 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e82 expref: 15 pid: 9522 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113820:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:3.0:1788725940.113826:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113836:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113845:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.113929:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725940.113993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+14:2396:x1875614770447360:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 705us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725940.114000:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00010000:00010000:0.0:1788725940.118985:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725940.119002:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725940.119664:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788725940.119786:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788725940.119823:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788725940.119904:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875614791497984:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788725940.119968:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.120672:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654840 going to sleep for 11 seconds 00000100:00100000:0.0:1788725940.125465:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791497984 00000100:00100000:0.0:1788725940.125479:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791497984 00000100:00100000:0.0:1788725940.126012:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788725940.126033:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875614791497984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788725940.126199:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875614791497984:12345-0@lo:1000:mdt00_002.0 Request processed in 168us (6230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.126207:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788725940.126297:0:6512:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788725940.126303:0:6512:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b12833bf100, transno 4294967304 00000100:00100000:2.0:1788725940.126327:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283632d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875614791497984:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788725940.126495:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788725940.126579:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875614791498112:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788725940.126625:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725940.132553:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725940.135159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498112 00000100:00100000:1.0:1788725940.135175:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498112 00000100:00100000:1.0:1788725940.135238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788725940.135248:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6512:x1875614791498112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788725940.135451:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6512:x1875614791498112:12345-0@lo:1000:mdt00_002.0 Request processed in 204us (8824us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788725940.135459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788725940.135710:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6512:1875614791498112:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788725940.135764:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135775:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135784:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135791:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725940.135796:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135803:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135819:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:2.0:1788725940.135823:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788725940.135827:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135834:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d3749f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135864:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135871:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135892:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135898:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725940.135901:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135907:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135917:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:2.0:1788725940.135919:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788725940.135922:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135928:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d373d4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135972:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135985:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.135993:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.136038:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725940.136062:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 17 pid: 6510 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725940.136076:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791498240:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725940.136176:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725940.144452:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791498240:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725940.144494:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725940.146035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725940.146286:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770447488 00000100:00100000:3.0:1788725940.146295:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770447488 00010000:00010000:3.0:1788725940.146333:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 18 pid: 6510 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725940.146383:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788725940.146393:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:2395:x1875614770447488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725940.146407:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725940.146413:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 18 pid: 6510 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146426:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 18 pid: 6510 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146469:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d373f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e66 expref: 18 pid: 6510 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146503:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:3.0:1788725940.146508:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146518:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146525:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.146556:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725940.146603:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:2395:x1875614770447488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 211us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725940.146610:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00010000:00010000:1.0:1788725940.146792:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146810:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146821:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146827:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146833:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146837:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725940.146842:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146848:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146858:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:1.0:1788725940.146860:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725940.146864:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146870:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d374a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146882:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146887:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146897:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146902:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725940.146905:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146911:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146919:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1382afe800) 00010000:00010000:1.0:1788725940.146921:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788725940.146923:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.146929:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37498 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725940.147069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+16:11295:x1875614770447104:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 62248us (62515us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788725940.147078:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000020:00080000:1.0:1788725940.147082:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788725940.147866:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788725940.147873:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788725940.147889:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788725940.147895:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725940.154099:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725940.154330:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770447744 00000100:00100000:3.0:1788725940.154339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770447744 00000100:00100000:3.0:1788725940.154409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788725940.154421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+16:11295:x1875614770447744:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788725940.154690:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788725940.154723:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788725940.154772:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154787:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154798:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154806:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154813:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154820:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725940.154845:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788725940.154929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+18:11295:x1875614770447744:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 508us (840us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788725940.154937:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000020:00080000:3.0:1788725940.154942:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788725940.155045:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788725940.155052:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.155060:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788725940.155064:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.155079:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.155093:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:1.0:1788725940.155096:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788725940.155100:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.155106:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725940.155157:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725940.155159:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725940.155161:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725940.348032:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725940.348058:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791498368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725940.348140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725940.348252:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498368 00000100:00100000:2.0:1788725940.348266:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498368 00000100:00100000:2.0:1788725940.348320:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725940.348329:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791498368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725940.348349:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788725940.348395:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791498368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725940.348402:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788725940.348593:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791498368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725940.348823:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791498496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725940.348852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.348925:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498496 00000100:00100000:1.0:1788725940.348930:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498496 00000100:00100000:1.0:1788725940.348977:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788725940.348985:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791498496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725940.348996:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788725940.349032:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791498496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725940.349038:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788725940.349068:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791498496:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788725940.349282:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725940.350845:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.350906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.350956:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791499392:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.350981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.351011:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791499904:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.351033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.351058:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788725940.351063:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791499008:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.351084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.351103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791499520:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.351146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725940.351180:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499392 00000100:00100000:1.0:1788725940.351187:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499392 00000100:00100000:1.0:1788725940.351227:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499904 00000100:00100000:1.0:1788725940.351230:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499904 00000100:00100000:1.0:1788725940.351249:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499008 00000100:00100000:1.0:1788725940.351252:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499008 00000100:00100000:1.0:1788725940.351269:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788725940.351278:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791499392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.351327:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791499392:12345-0@lo:400:kworker.0 Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725940.351334:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788725940.351360:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788725940.351367:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.351830:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791498624:0@lo:400:kworker.0 00000100:00100000:2.0:1788725940.351914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498880 00000100:00100000:2.0:1788725940.351920:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498880 00000100:00100000:2.0:1788725940.351953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788725940.351961:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791498880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.352178:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791498752:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725940.357548:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357590:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725940.357612:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791499648:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788725940.357684:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788725940.357701:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499136 00000100:00100000:0.0:1788725940.357708:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499136 00000100:00100000:0.0:1788725940.357743:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788725940.357751:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791499136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357819:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791499136:12345-0@lo:400:kworker.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.357826:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788725940.357866:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791499136:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357896:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788725940.357904:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791499008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.357939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791499008:12345-0@lo:400:kworker.0 Request processed in 36us (6853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.357945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788725940.357966:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499520 00000100:00100000:0.0:1788725940.357970:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499520 00000100:00100000:0.0:1788725940.357997:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499648 00000100:00100000:0.0:1788725940.358000:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499648 00000100:00100000:0.0:1788725940.358016:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788725940.358022:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791499520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358247:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791499520:12345-0@lo:400:kworker.0 Request processed in 224us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.358254:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788725940.358266:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788725940.358272:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1875614791499648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358303:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1875614791499648:12345-0@lo:400:kworker.0 Request processed in 32us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.358309:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788725940.358323:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725940.358342:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791499648:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358410:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791499008:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358421:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791499520:0@lo:400:kworker.0 00010000:00080000:0.0:1788725940.358435:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283c93b80 x1875614791499392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725940.358446:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791499392:0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498624 00000100:00100000:0.0:1788725940.358570:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498624 00000100:00100000:0.0:1788725940.358595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788725940.358601:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791498624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.358637:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791498624:12345-0@lo:400:kworker.0 Request processed in 36us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.358643:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788725940.358677:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791498624:0@lo:400:kworker.0 00000100:00100000:1.0:1788725940.363376:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791499904:12345-0@lo:400:kworker.0 Request processed in 11998us (12330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725940.363392:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:1.0:1788725940.363462:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283c92d80 x1875614791499904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725940.363477:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791499904:0@lo:400:kworker.0 00000100:00100000:2.0:1788725940.364042:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791498880:12345-0@lo:400:kworker.0 Request processed in 12079us (13134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725940.364062:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788725940.368275:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791498880:0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.379695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725940.379752:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791499264:0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.379783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725940.379816:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791499776:0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.379838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725940.379962:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791498752 00000100:00100000:0.0:1788725940.379971:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791498752 00000100:00100000:0.0:1788725940.380028:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499264 00000100:00100000:0.0:1788725940.380031:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499264 00000100:00100000:0.0:1788725940.380068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791499776 00000100:00100000:0.0:1788725940.380071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791499776 00000100:00100000:0.0:1788725940.380090:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788725940.380097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791498752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.380182:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791498752:12345-0@lo:400:kworker.0 Request processed in 84us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.380189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788725940.380207:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788725940.380227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.380257:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791499264:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.380273:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788725940.380286:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788725940.380293:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791499776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725940.380322:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791499776:12345-0@lo:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725940.380327:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1788725940.380355:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725940.381634:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12823d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791498752:0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.381667:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791499264:0@lo:400:kworker.0 00000100:00100000:3.0:1788725940.381680:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791499776:0@lo:400:kworker.0 00010000:00010000:3.0:1788725941.115539:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725941.371277:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725941.371300:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791500032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725941.371366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725941.371502:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791500032 00000100:00100000:2.0:1788725941.371511:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791500032 00000100:00100000:2.0:1788725941.371572:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788725941.371583:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791500032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725941.371616:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725941.371678:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791500032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725941.371686:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788725941.371733:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791500032:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788725941.590822:0:14252:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725941.590833:0:14252:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725941.590857:0:14252:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788725941.590864:0:14252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788725941.744665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725941.744719:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770448000 00000100:00100000:0.0:1788725941.744729:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770448000 00000100:00080000:1.0:1788725941.744802:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725941.744810:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788725941.744821:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:11313:x1875614770448000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725941.744846:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725941.744866:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d374b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6e9e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.744968:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d374bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.744982:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d374bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.744993:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d374bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725941.745004:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788725941.745171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d374b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e9e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.745189:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d374bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e9e expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.745197:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725941.745201:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788725941.745204:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8600, rc 0) 00000100:00100000:1.0:1788725941.745449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:11313:x1875614770448000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 628us (792us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788725941.745457:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788725941.750465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.750529:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770448128 00000100:00100000:1.0:1788725941.750538:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770448128 00000100:00100000:1.0:1788725941.750602:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788725941.750613:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+20:11313:x1875614770448128:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788725941.750687:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750703:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750716:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750731:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750738:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750745:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750828:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750836:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750842:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725941.750890:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750902:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750909:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750980:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750986:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725941.750991:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.750998:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751010:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:1.0:1788725941.751013:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725941.751018:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751031:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d374c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751043:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751049:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751055:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751060:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725941.751063:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751069:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751076:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283234300) 00010000:00010000:1.0:1788725941.751079:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725941.751081:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751087:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d374d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751100:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751106:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751386:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751392:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725941.751396:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751403:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751412:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b1283234500) 00010000:00010000:1.0:1788725941.751414:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725941.751417:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.751423:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d374d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725941.751549:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+20:11313:x1875614770448128:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 936us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725941.751557:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788725941.819646:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725941.819725:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770448384 00000100:00100000:3.0:1788725941.819735:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770448384 00000100:00100000:3.0:1788725941.819797:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788725941.819808:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:11316:x1875614770448384:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725941.819828:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725941.819849:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d374de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ea5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.819928:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.819943:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.819964:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.819981:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.819988:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820004:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820428:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820437:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820446:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725941.820455:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788725941.820537:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820545:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820551:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820558:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725941.820562:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820569:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820581:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725941.820584:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725941.820596:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820602:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d374e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820616:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820622:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820627:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820632:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725941.820634:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820640:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820648:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b128220ba00) 00010000:00010000:3.0:1788725941.820650:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725941.820652:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820657:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d374ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820699:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d374de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820724:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.820732:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:3.0:1788725941.820734:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725941.820737:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:3.0:1788725941.820802:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:11316:x1875614770448384:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 995us (1163us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788725941.820809:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788725941.823544:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.823949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770448512 00000100:00100000:1.0:1788725941.824030:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770448512 00000100:00100000:1.0:1788725941.824232:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:1.0:1788725941.824243:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+22:11316:x1875614770448512:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725941.824308:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824341:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824353:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824390:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824396:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824402:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824408:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725941.824411:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824418:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824429:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:1.0:1788725941.824432:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725941.824436:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.824442:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37501 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725941.824554:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+22:11316:x1875614770448512:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 311us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725941.824568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1788725941.826728:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725941.826811:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770448768 00000100:00100000:3.0:1788725941.826820:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770448768 00000100:00100000:3.0:1788725941.826873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788725941.826883:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:11316:x1875614770448768:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725941.827076:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+23:11316:x1875614770448768:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 194us (356us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788725941.827083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788725941.877211:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.878862:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449024 00000100:00100000:1.0:1788725941.878874:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449024 00000100:00100000:1.0:1788725941.878958:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788725941.878968:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+23:10832:x1875614770449024:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725941.878997:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725941.879037:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37508 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6eac expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.879171:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.879185:0:9522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.879194:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.879232:0:9522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.879245:0:9522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 24 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725941.879261:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12837f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791500160:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725941.879529:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12836540c0 going to sleep for 11 seconds 00000001:00080000:3.0:1788725941.890310:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788725941.890326:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788725941.891629:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.891838:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12837f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791500160:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725941.891880:0:9522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725941.892179:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449152 00000100:00100000:3.0:1788725941.892186:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449152 00010000:00010000:3.0:1788725941.892226:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 25 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725941.892267:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788725941.892285:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+25:2395:x1875614770449152:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725941.892299:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725941.892306:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 25 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892317:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 25 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892349:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d374f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ea5 expref: 25 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892365:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:3.0:1788725941.892369:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892378:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892385:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725941.892412:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725941.892472:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:2395:x1875614770449152:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 189us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725941.892490:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00010000:00010000:1.0:1788725941.894298:0:9522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.894314:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725941.894337:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788725941.894474:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37508 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 25 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.894506:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 24 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.894515:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:1.0:1788725941.894518:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725941.894521:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788725941.894584:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:10832:x1875614770449024:12345-192.168.203.12@tcp:101:bash.0 Request processed in 15617us (17382us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788725941.894594:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:2.0:1788725941.900072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725941.900171:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449280 00000100:00100000:0.0:1788725941.900181:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449280 00000100:00100000:0.0:1788725941.900242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1788725941.900253:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:10832:x1875614770449280:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725941.900277:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725941.901839:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d3751d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6eb3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.901894:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.901908:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.901921:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.902945:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d3751d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eb3 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.902985:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eb3 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.902995:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:0.0:1788725941.902998:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788725941.903001:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9c00, rc 0) 00000100:00100000:0.0:1788725941.904209:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+25:10832:x1875614770449280:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3949us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725941.904219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:0.0:1788725941.917992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.918087:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449536 00000100:00100000:1.0:1788725941.918097:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449536 00000100:00100000:1.0:1788725941.918198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:1.0:1788725941.918208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:10832:x1875614770449536:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788725941.918432:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.918465:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.918487:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725941.918531:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788725941.918554:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005be1e636 reply state 00000000ce672737 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.918566:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.918573:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:1.0:1788725941.918576:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725941.918579:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788725941.918671:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788725941.918770:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+29:10832:x1875614770449536:12345-192.168.203.12@tcp:36:bash.0 Request processed in 562us (786us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788725941.918777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000020:00080000:1.0:1788725941.918782:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788725941.934569:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725941.935037:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449664 00000100:00100000:1.0:1788725941.935049:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449664 00000100:00100000:1.0:1788725941.935157:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1788725941.935172:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+29:10832:x1875614770449664:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725941.935198:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725941.935216:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37532 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6eba expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.935813:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37532 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eba expref: 30 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.935831:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37532 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eba expref: 30 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725941.935852:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:1.0:1788725941.935855:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725941.935859:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725941.935921:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+30:10832:x1875614770449664:12345-192.168.203.12@tcp:101:bash.0 Request processed in 754us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725941.935929:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788725941.942644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725941.945168:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449792 00000100:00100000:0.0:1788725941.945192:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449792 00000100:00100000:0.0:1788725941.945282:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1788725941.945294:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:10832:x1875614770449792:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725941.945310:0:8716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725941.945330:0:8716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ec1 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725941.945354:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9dcab1, atime: 0x6a9dcaaf, ctime: 0x6a9dcab1, blocks: 0x8 00010000:00010000:0.0:1788725941.945373:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1788725941.945378:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725941.945387:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.945404:0:8716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725941.945432:0:8716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8a00, rc 0) 00000100:00080000:1.0:1788725941.945446:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725941.945511:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:10832:x1875614770449792:12345-192.168.203.12@tcp:101:bash.0 Request processed in 220us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725941.945518:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1788725941.952104:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725941.952499:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770449920 00000100:00100000:2.0:1788725941.952509:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770449920 00002000:00010000:2.0:1788725941.952550:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788725941.952555:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b128367f480 with x1875614770449920 ext(0->18446744073709551615) 00002000:00010000:2.0:1788725941.952567:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b128367f480. 00000100:00100000:2.0:1788725941.952603:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788725941.952621:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770449920:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:2.0:1788725941.952884:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788725941.952888:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788725937 -> 1788725941 00002000:00010000:2.0:1788725941.952891:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788725935 -> 1788725935 00002000:00010000:2.0:1788725941.952893:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788725937 -> 1788725941 00002000:00010000:2.0:1788725941.952895:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788725941.952971:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770449920:12345-192.168.203.12@tcp:10:bash.0 Request processed in 359us (877us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788725941.952979:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00010000:2.0:1788725941.952985:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788725941.952988:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b128367f480 with x1875614770449920 ext(0->18446744073709551615) 00002000:00010000:2.0:1788725941.952992:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b128367f480. 00000100:00100000:1.0:1788725942.100187:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.100228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770450048 00000100:00100000:0.0:1788725942.100238:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770450048 00000100:00100000:0.0:1788725942.100346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:0.0:1788725942.100357:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:11330:x1875614770450048:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788725942.100427:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.100442:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.100454:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.100484:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.100491:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.100498:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101704:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101735:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101744:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725942.101793:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101804:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101811:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101829:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101834:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.101839:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101845:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101857:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725942.101859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.101863:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101869:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37540 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101889:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101895:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101900:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101905:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.101908:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101914:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101935:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1391f3e000) 00010000:00010000:0.0:1788725942.101938:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.101944:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101950:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37547 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101965:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101970:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101976:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101988:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.101992:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.101998:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.102006:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:0.0:1788725942.102009:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.102012:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.102018:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3754e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725942.104753:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:11330:x1875614770450048:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 4387us (4563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725942.104767:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00010000:00010000:1.0:1788725942.139897:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725942.159523:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725942.159644:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770450304 00000100:00100000:3.0:1788725942.159652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770450304 00000100:00100000:3.0:1788725942.159707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:3.0:1788725942.159716:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+30:11333:x1875614770450304:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725942.159746:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725942.159763:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37555 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ec8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159828:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159841:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159852:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159865:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159872:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159878:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159971:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d3756a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159979:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d3756a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.159986:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d3756a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725942.159996:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788725942.160085:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160093:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160100:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160105:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725942.160109:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160143:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160155:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725942.160158:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725942.160162:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160168:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3755c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160181:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160187:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160193:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160198:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725942.160205:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160211:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160218:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b128220b600) 00010000:00010000:3.0:1788725942.160220:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725942.160223:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160228:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37563 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160261:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37555 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec8 expref: 33 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160273:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d3756a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec8 expref: 32 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.160281:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:3.0:1788725942.160283:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788725942.160286:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044e00, rc 0) 00000100:00100000:3.0:1788725942.160509:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+32:11333:x1875614770450304:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 792us (994us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788725942.160516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:1.0:1788725942.166906:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.167062:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770450432 00000100:00100000:2.0:1788725942.167070:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770450432 00000100:00100000:2.0:1788725942.167142:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1788725942.167153:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+32:11333:x1875614770450432:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:2.0:1788725942.167228:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.167244:0:9522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 32 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.167254:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.167286:0:9522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 32 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.167310:0:9522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 32 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.167324:0:9522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791500288:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725942.167412:0:9522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707180 going to sleep for 11 seconds 00000100:00100000:1.0:1788725942.174523:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.174666:0:9522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9522:1875614791500288:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725942.174693:0:9522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725942.174900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770450688 00000100:00100000:3.0:1788725942.174907:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770450688 00000100:00100000:3.0:1788725942.174967:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725942.174977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+33:6165:x1875614770450688:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788725942.175574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+34:6165:x1875614770450688:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 595us (1057us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788725942.175582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725942.178930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.183623:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770450816 00000100:00100000:2.0:1788725942.183645:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770450816 00010000:00010000:2.0:1788725942.183957:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 34 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.184079:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788725942.184091:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+34:2395:x1875614770450816:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725942.184206:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725942.184217:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 34 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184232:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 34 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184261:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d3750f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eac expref: 34 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184283:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:2.0:1788725942.184291:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184302:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184311:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.184606:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725942.185167:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+33:2395:x1875614770450816:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1013us (6257us total) trans 0 rc 0/0 00010000:00010000:1.0:1788725942.185173:0:9522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.185179:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00010000:00010000:1.0:1788725942.185208:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185262:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185270:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185520:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185525:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725942.185529:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185536:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185564:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:1.0:1788725942.185567:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725942.185571:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.185577:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37578 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725942.185666:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+32:11333:x1875614770450432:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 18509us (18765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.185676:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:1.0:1788725942.201610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.202105:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770451072 00000100:00100000:2.0:1788725942.202154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770451072 00000100:00100000:2.0:1788725942.202219:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788725942.202230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+32:11333:x1875614770451072:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725942.202456:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+33:11333:x1875614770451072:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 227us (854us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788725942.202464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788725942.323631:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.323765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770451328 00000100:00100000:0.0:1788725942.323778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770451328 00000100:00100000:0.0:1788725942.324022:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1788725942.324037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+33:11344:x1875614770451328:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788725942.324071:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725942.324099:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3757f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ecf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324311:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324485:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324552:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324572:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324579:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.324586:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.325019:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.325030:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.325037:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725942.325048:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788725942.326056:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.326070:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.326077:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.326100:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.326960:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.326972:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.326993:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725942.326996:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.327001:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327008:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37586 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327027:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327033:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327039:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327044:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.327048:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327054:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327080:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1391f3e000) 00010000:00010000:0.0:1788725942.327083:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.327086:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327092:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d3758d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327895:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3757f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ecf expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327916:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ecf expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.327924:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:0.0:1788725942.327926:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725942.327929:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8000, rc 0) 00000100:00100000:0.0:1788725942.328028:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+35:11344:x1875614770451328:12345-192.168.203.12@tcp:101:cat.0 Request processed in 3994us (4412us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788725942.328038:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:3.0:1788725942.347506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.347613:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770451584 00000100:00100000:2.0:1788725942.347621:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770451584 00000100:00100000:2.0:1788725942.347675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788725942.347685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+35:11344:x1875614770451584:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:2.0:1788725942.347963:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+36:11344:x1875614770451584:12345-192.168.203.12@tcp:35:cat.0 Request processed in 279us (466us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788725942.347971:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788725942.377905:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.377992:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770451840 00000100:00100000:2.0:1788725942.378010:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770451840 00000100:00100000:2.0:1788725942.378067:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:2.0:1788725942.378076:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+36:11345:x1875614770451840:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:2.0:1788725942.378161:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788725942.378198:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37532 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eba expref: 36 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378220:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ecf expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378233:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d3756a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec8 expref: 34 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378261:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eb3 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378271:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:2.0:1788725942.378275:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725942.378294:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378306:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378315:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378337:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378344:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378351:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378423:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378430:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378437:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788725942.378637:0:11950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788725942.378647:0:11950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387534528987ns, next at 388534525949ns, rc = 0 00010000:00010000:2.0:1788725942.378685:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378694:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378700:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378707:0:11950:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378713:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378720:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378745:0:11950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788725942.378760:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378766:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378772:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378778:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725942.378787:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378796:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378804:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:2.0:1788725942.378807:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788725942.378810:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378817:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375b0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378829:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378835:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378840:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378846:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725942.378849:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378854:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378860:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725942.378862:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725942.378868:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378874:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725942.378884:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d6ff8e1 reply state 000000004ef9677e transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378894:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.378900:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:2.0:1788725942.378902:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725942.378904:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725942.378972:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+34:11345:x1875614770451840:12345-192.168.203.12@tcp:36:rm.0 Request processed in 895us (1075us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788725942.378979:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00010000:00010000:3.0:1788725942.379298:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725942.379304:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.379311:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725942.379315:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.379329:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.379338:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:3.0:1788725942.379340:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788725942.379343:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.379349:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.379359:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725942.379361:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725942.379362:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725942.432083:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.432464:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452096 00000100:00100000:2.0:1788725942.432484:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452096 00000100:00100000:2.0:1788725942.432545:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1788725942.432556:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+34:11351:x1875614770452096:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725942.432580:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725942.432600:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ed6 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432701:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432715:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432745:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432759:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432767:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.432774:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788725942.433091:0:9522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788725942.433988:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434096:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434109:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434168:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434190:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434198:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434203:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725942.434220:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434227:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434240:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725942.434243:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725942.434247:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434253:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d375c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725942.434267:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc61dd36 reply state 000000008268f506 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434277:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434283:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:2.0:1788725942.434286:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725942.434288:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788725942.434316:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d375be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 37 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434332:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 36 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.434340:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.434342:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725942.434352:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658600, rc 0) 00000100:00100000:2.0:1788725942.434419:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+37:11351:x1875614770452096:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1864us (2345us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788725942.434427:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:0.0:1788725942.437986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.438157:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452224 00000100:00100000:2.0:1788725942.438166:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452224 00000100:00100000:2.0:1788725942.438240:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788725942.438250:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770452224:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725942.438267:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725942.438288:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6edd expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788725942.438312:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788725942.438363:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788725942.438368:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725942.438378:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.438400:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.438415:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725942.438484:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770452224:12345-192.168.203.12@tcp:101:bash.0 Request processed in 226us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725942.438871:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00080000:1.0:1788725942.439428:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725942.443534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.443620:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452352 00000100:00100000:0.0:1788725942.443629:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452352 00000100:00100000:0.0:1788725942.443685:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:0.0:1788725942.443696:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:11351:x1875614770452352:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725942.443714:0:8716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725942.443731:0:8716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ee4 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.443775:0:8716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.443784:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725942.443789:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725942.443794:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.443828:0:8716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.443842:0:8716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 7 pid: 8426 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725942.443856:0:8716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791500416:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725942.443955:0:8716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725942.446619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.446770:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452480 00000100:00100000:2.0:1788725942.446778:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452480 00010000:00010000:2.0:1788725942.446823:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 8 pid: 8426 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.446862:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788725942.446870:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770452480:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725942.446883:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725942.446901:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 8 pid: 8426 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.446915:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 8 pid: 8426 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.446938:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725942.446943:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725942.446951:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 8 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.446962:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 8 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.446993:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 8 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.447010:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875614791500544:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788725942.447083:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788725942.447750:0:8716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082049fb8/0xa13c582691d375e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6edd expref: 8 pid: 8426 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725942.447771:0:8716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791500416:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725942.447797:0:8716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 7 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.447809:0:8716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9e00, rc 0) 00000100:00100000:0.0:1788725942.447867:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:11351:x1875614770452352:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4172us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725942.447875:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788725942.452491:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875614791500544:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788725942.452538:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725942.452631:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770452480:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5760us (6018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725942.452641:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788725942.464390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.464629:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452736 00000100:00100000:2.0:1788725942.464639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452736 00000100:00100000:2.0:1788725942.464691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788725942.464700:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:11351:x1875614770452736:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788725942.464967:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:11351:x1875614770452736:12345-192.168.203.12@tcp:35:bash.0 Request processed in 267us (586us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788725942.464975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788725942.674162:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.674264:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770452864 00000100:00100000:0.0:1788725942.674273:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770452864 00000100:00100000:0.0:1788725942.674342:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:0.0:1788725942.674352:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+38:11367:x1875614770452864:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725942.674376:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725942.674394:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d375ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6eeb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674460:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674484:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674507:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725942.674553:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788725942.674557:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725942.674578:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674603:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d375ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eeb expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674621:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eeb expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.674651:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725942.674655:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725942.674658:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788725942.674723:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+39:11367:x1875614770452864:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 371us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725942.674731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1788725942.681509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.681588:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453120 00000100:00100000:0.0:1788725942.681597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453120 00000100:00100000:0.0:1788725942.681650:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:0.0:1788725942.681659:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+39:11367:x1875614770453120:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725942.681678:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725942.681697:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d375fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ef2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.681791:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.681804:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.681815:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725942.681825:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788725942.681914:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d375fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef2 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.681951:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef2 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.681959:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:0.0:1788725942.681962:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725942.681965:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9a00, rc 0) 00000100:00100000:0.0:1788725942.682029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:11367:x1875614770453120:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 371us (527us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788725942.682035:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:3.0:1788725942.686515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.687895:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453376 00000100:00100000:2.0:1788725942.687907:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453376 00000100:00100000:2.0:1788725942.687962:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:2.0:1788725942.687971:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+41:11367:x1875614770453376:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725942.687994:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725942.688030:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ef9 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.688165:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.688178:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.688190:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725942.688219:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788725942.688318:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef9 expref: 44 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.688351:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef9 expref: 43 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.688360:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.688362:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788725942.688366:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658800, rc 0) 00000100:00100000:2.0:1788725942.688417:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+43:11367:x1875614770453376:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 447us (1910us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788725942.688423:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:1.0:1788725942.694079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.694438:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453504 00000100:00100000:2.0:1788725942.694448:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453504 00000100:00100000:2.0:1788725942.694525:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788725942.694535:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+43:2395:x1875614770453504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725942.694550:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725942.694575:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef2 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.694592:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.694597:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725942.694780:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+42:2395:x1875614770453504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 245us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725942.694788:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788725942.696998:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.697650:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453632 00000100:00100000:2.0:1788725942.697659:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453632 00000100:00100000:2.0:1788725942.697753:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788725942.697765:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770453632:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:2.0:1788725942.697807:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.697826:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 6 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.697834:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725942.697838:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725942.697843:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.697876:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 6 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.697890:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 6 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.697903:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791500672:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725942.698046:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788725942.701717:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.701785:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453760 00000100:00100000:0.0:1788725942.701793:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453760 00002000:00100000:0.0:1788725942.701835:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b1283caf800 x1875614770453760/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:338/0 lens 504/0 e 0 to 0 dl 1788725953 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788725942.701846:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283caf800 with x1875614770453760 ext(0->8) 00010000:00010000:0.0:1788725942.701855:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 7 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.701869:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 7 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725942.701877:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b1283caf800 00000100:00100000:0.0:1788725942.701911:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788725942.701920:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770453760:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:0.0:1788725942.702937:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770453760:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1011us (1223us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788725942.702955:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00002000:00100000:0.0:1788725942.702965:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9b1283caf800 x1875614770453760/t4294967303(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:338/0 lens 504/448 e 0 to 0 dl 1788725953 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788725942.702974:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283caf800 with x1875614770453760 ext(0->8) 00010000:00010000:0.0:1788725942.702980:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.702993:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725942.703011:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b1283caf800 00000100:00100000:2.0:1788725942.703149:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791500672:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725942.703173:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725942.706824:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725942.706933:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770453888 00000100:00100000:3.0:1788725942.706943:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770453888 00010000:00010000:3.0:1788725942.706981:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725942.707307:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788725942.707319:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+9:2398:x1875614770453888:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725942.707346:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788725942.707364:0:10330:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788725942.707367:0:10330:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788725941 00002000:00010000:3.0:1788725942.707370:0:10330:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788725942 00002000:00010000:3.0:1788725942.707372:0:10330:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788725941 00002000:00010000:3.0:1788725942.707374:0:10330:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788725942.707381:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.707396:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.707420:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7ee580/0xa13c582691d375e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ee4 expref: 9 pid: 8716 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.707437:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725942.707442:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725942.707447:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.707479:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.707525:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725942.707580:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab291850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770453888:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 264us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725942.707589:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00010000:00010000:0.0:1788725942.707666:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707676:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707696:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707704:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707711:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707728:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725942.707732:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707740:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707752:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.707759:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016dcf9ae/0xa13c582691d37627 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725942.707805:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770453632:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 10042us (10815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725942.707813:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788725942.711446:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.711957:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770454144 00000100:00100000:2.0:1788725942.711967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770454144 00000100:00100000:2.0:1788725942.712480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788725942.712504:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+42:11367:x1875614770454144:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:2.0:1788725942.712567:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef9 expref: 42 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725942.712740:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788725942.712771:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788725942.713210:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788725942.713251:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.713268:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 46 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.713278:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.713313:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 46 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.713486:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 46 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.713512:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791500800:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725942.713598:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725942.718809:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c90380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791500800:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725942.718837:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725942.718901:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.718968:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770454272 00000100:00100000:2.0:1788725942.718974:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770454272 00010000:00010000:2.0:1788725942.719015:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 47 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.719136:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:2.0:1788725942.719148:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+47:2396:x1875614770454272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725942.719162:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725942.719169:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 47 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719182:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 47 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719202:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d375d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ed6 expref: 47 pid: 9522 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719216:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.719221:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719229:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719236:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.719277:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725942.719321:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+46:2396:x1875614770454272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 175us (420us total) trans 0 rc 0/0 00010000:00010000:1.0:1788725942.719526:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.719533:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725942.719642:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788725942.719747:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788725942.719823:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12837f6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791500928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788725942.719865:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725942.719901:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654600 going to sleep for 11 seconds 00000100:00100000:2.0:1788725942.720167:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788725942.721102:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791500928 00000100:00100000:3.0:1788725942.721112:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791500928 00000100:00100000:3.0:1788725942.721196:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788725942.721207:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791500928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788725942.721307:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791500928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725942.721313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788725942.721406:0:6513:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1788725942.721412:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1788725942.721429:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b13832b9c00, transno 4294967302 00000100:00100000:0.0:1788725942.721448:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12837f6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791500928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788725942.721577:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788725942.721638:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791501056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788725942.721673:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725942.721691:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788725942.722277:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791501056 00000100:00100000:3.0:1788725942.722283:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791501056 00000100:00100000:3.0:1788725942.722309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788725942.722317:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875614791501056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788725942.722430:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1875614791501056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (756us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788725942.722438:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788725942.722480:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791501056:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788725942.722808:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788725942.723391:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788725942.723446:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723457:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723464:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723479:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725942.723484:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723491:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723507:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.723510:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788725942.723515:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.723521:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d3762e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788725942.723617:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788725942.723684:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788725942.723695:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387879576765ns, next at 388879574903ns, rc = 0 00000001:00080000:2.0:1788725942.723701:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788725942.723725:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725942.723728:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788725942.723735:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d37619 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ef9 expref: 50 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725942.723873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+49:11367:x1875614770454144:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 11382us (12436us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788725942.723882:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000020:00080000:2.0:1788725942.723886:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788725942.727561:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725942.727638:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770454400 00000100:00100000:2.0:1788725942.727647:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770454400 00000100:00100000:2.0:1788725942.727746:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:2.0:1788725942.727757:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+49:11367:x1875614770454400:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725942.727780:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725942.727804:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37635 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f00 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.727859:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37635 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f00 expref: 50 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.727871:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37635 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f00 expref: 50 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725942.727888:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:2.0:1788725942.727892:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788725942.727907:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725942.727963:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+50:11367:x1875614770454400:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 208us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725942.727970:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 111 00000100:00100000:1.0:1788725942.731920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725942.731995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770454656 00000100:00100000:3.0:1788725942.732012:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770454656 00000100:00100000:3.0:1788725942.732068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788725942.732089:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+50:11367:x1875614770454656:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725942.732322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+51:11367:x1875614770454656:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 234us (412us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788725942.732337:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788725942.822587:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725942.822686:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770454784 00000100:00100000:3.0:1788725942.822695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770454784 00000100:00100000:3.0:1788725942.822753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:3.0:1788725942.822763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+51:11377:x1875614770454784:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788725942.822827:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822842:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822853:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822863:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822870:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822876:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822937:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822945:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.822961:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788725942.823006:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823029:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823035:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823042:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823048:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725942.823052:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823060:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823071:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:3.0:1788725942.823075:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725942.823080:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823086:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3763c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823100:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823112:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823169:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823174:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725942.823177:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823184:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823192:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:3.0:1788725942.823195:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725942.823198:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823203:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37643 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823213:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823219:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823226:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823231:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725942.823239:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823245:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823254:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725942.823256:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725942.823259:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725942.823265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d3764a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725942.823323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+51:11377:x1875614770454784:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 561us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725942.823330:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 112 00000100:00100000:1.0:1788725942.877479:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725942.877876:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455040 00000100:00100000:0.0:1788725942.877885:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455040 00000100:00100000:0.0:1788725942.877981:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:0.0:1788725942.877992:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+51:11380:x1875614770455040:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725942.878199:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725942.878220:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37651 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f07 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878292:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878305:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878317:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878433:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878441:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878448:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878706:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37666 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878715:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878737:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725942.878747:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788725942.878821:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878828:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878835:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878841:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.878845:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878851:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878862:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725942.878865:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.878869:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878876:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37658 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878890:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878896:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878910:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878915:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725942.878918:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.878924:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.879206:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:0.0:1788725942.879210:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725942.879214:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.879221:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3765f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.879261:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37651 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f07 expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.879276:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f07 expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725942.879284:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725942.879286:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725942.879288:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9e00, rc 0) 00000100:00100000:0.0:1788725942.879364:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+53:11380:x1875614770455040:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1374us (1903us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788725942.879381:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 113 00000100:00100000:3.0:1788725942.882951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725942.883255:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455168 00000100:00100000:1.0:1788725942.883265:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455168 00000100:00100000:1.0:1788725942.883331:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1788725942.883343:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+53:11380:x1875614770455168:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725942.883404:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883420:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883448:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883502:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883510:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883517:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883523:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725942.883528:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883535:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883549:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725942.883552:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725942.883557:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725942.883563:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37674 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725942.883629:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+53:11380:x1875614770455168:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 288us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725942.883638:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:3.0:1788725942.885861:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725942.885953:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455424 00000100:00100000:1.0:1788725942.885962:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455424 00000100:00100000:1.0:1788725942.886027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:1.0:1788725942.886037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+53:11380:x1875614770455424:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788725942.886257:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+54:11380:x1875614770455424:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 221us (403us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788725942.886265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788725942.907464:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725942.907508:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725942.907577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725942.907886:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791501184 00000100:00100000:0.0:1788725942.907894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791501184 00000100:00100000:0.0:1788725942.907940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788725942.907950:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791501184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788725942.907983:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788725942.908057:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791501184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725942.908063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788725942.908166:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791501184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725943.030204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.031104:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455680 00000100:00100000:2.0:1788725943.031156:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455680 00000100:00100000:2.0:1788725943.031232:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1788725943.031244:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+54:11390:x1875614770455680:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725943.031281:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.031284:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788725943.031309:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d375f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6eeb expref: 54 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031328:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725943.031334:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725943.031345:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3767b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f0e expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031447:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031460:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031480:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725943.031490:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788725943.031602:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3767b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f0e expref: 56 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031633:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f0e expref: 55 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.031640:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:2.0:1788725943.031642:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725943.031644:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725943.031705:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+55:11390:x1875614770455680:12345-192.168.203.12@tcp:101:bash.0 Request processed in 464us (1510us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788725943.031712:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00080000:1.0:1788725943.032173:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725943.036388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.036430:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.036520:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455808 00000100:00100000:1.0:1788725943.036529:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455808 00000100:00100000:1.0:1788725943.036587:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:1.0:1788725943.036597:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+55:11390:x1875614770455808:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725943.036620:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725943.036638:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37690 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f15 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036669:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036682:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036692:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036796:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37690 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 57 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036823:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 56 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.036832:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.036835:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788725943.036838:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788725943.036897:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+56:11390:x1875614770455808:12345-192.168.203.12@tcp:101:bash.0 Request processed in 301us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.036904:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1788725943.037236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770455936 00000100:00100000:2.0:1788725943.037241:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770455936 00000100:00100000:2.0:1788725943.037288:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788725943.037297:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+56:2396:x1875614770455936:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725943.037305:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.037318:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f0e expref: 56 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.037332:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:2.0:1788725943.037335:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.037362:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+55:2396:x1875614770455936:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 67us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.037369:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788725943.053219:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.054303:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770456192 00000100:00100000:0.0:1788725943.054316:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770456192 00000100:00100000:0.0:1788725943.054379:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788725943.054388:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+55:11390:x1875614770456192:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:0.0:1788725943.054439:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725943.054464:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37666 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f07 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.054494:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.054499:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725943.054669:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.054683:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.054693:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788725943.054754:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1788725943.054776:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b02ed0fe reply state 0000000013e7b289 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.054789:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.054796:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.054798:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788725943.054801:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788725943.054896:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+57:11390:x1875614770456192:12345-192.168.203.12@tcp:36:bash.0 Request processed in 508us (1686us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788725943.054902:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000020:00080000:0.0:1788725943.054907:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788725943.058259:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.058376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770456320 00000100:00100000:0.0:1788725943.058384:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770456320 00000100:00100000:0.0:1788725943.058431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:0.0:1788725943.058441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+57:11390:x1875614770456320:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725943.058464:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725943.058495:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d376a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f1c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058614:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058628:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058637:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725943.058673:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788725943.058678:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725943.058695:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058720:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d376a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058736:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.058745:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.058748:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725943.058751:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9a00, rc 0) 00000100:00100000:0.0:1788725943.058807:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+58:11390:x1875614770456320:12345-192.168.203.12@tcp:101:bash.0 Request processed in 367us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.058814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788725943.068249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.068831:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770456576 00000100:00100000:3.0:1788725943.068841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770456576 00000100:00100000:3.0:1788725943.068906:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:3.0:1788725943.068917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+58:11390:x1875614770456576:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788725943.069360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+59:11390:x1875614770456576:12345-192.168.203.12@tcp:35:bash.0 Request processed in 443us (1117us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788725943.069368:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00010000:00010000:3.0:1788725943.163491:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725943.177395:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.177479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770456704 00000100:00100000:1.0:1788725943.177757:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770456704 00000100:00100000:1.0:1788725943.177880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788725943.177892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+59:11396:x1875614770456704:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725943.177916:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725943.177947:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d376b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f23 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178034:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178049:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178061:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725943.178168:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788725943.178172:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725943.178193:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178220:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d376b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f23 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178238:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f23 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.178247:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:1.0:1788725943.178250:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725943.178253:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fe00, rc 0) 00000100:00100000:1.0:1788725943.178323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770456704:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 433us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.178331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788725943.183218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.184609:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770456832 00000100:00100000:0.0:1788725943.184626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770456832 00000100:00100000:0.0:1788725943.184716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1788725943.184728:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770456832:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725943.184756:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725943.184784:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d376c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f2a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185158:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185198:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185212:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185228:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185236:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185243:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185548:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185559:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185567:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725943.185621:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788725943.185627:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725943.185652:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185667:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185688:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185695:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185703:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185709:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.185714:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185722:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185738:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725943.185742:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.185749:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185756:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d376c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185771:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185778:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185784:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185821:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.185825:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185831:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185841:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:0.0:1788725943.185843:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.185846:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.185853:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d376cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.186020:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d376c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f2a expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.186038:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f2a expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.186047:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.186050:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725943.186052:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8000, rc 0) 00000100:00100000:0.0:1788725943.186276:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+61:11396:x1875614770456832:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1548us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.186286:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1788725943.190347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.190426:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.190522:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457216 00000100:00100000:3.0:1788725943.190535:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457216 00000100:00100000:3.0:1788725943.190613:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788725943.190626:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+61:2397:x1875614770457216:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725943.190645:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725943.190678:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d376d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f2a expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.190702:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725943.190708:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725943.190779:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+60:2397:x1875614770457216:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 155us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.190786:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788725943.191779:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457088 00000100:00100000:1.0:1788725943.191791:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457088 00000100:00100000:1.0:1788725943.191849:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1788725943.191861:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770457088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725943.191942:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725943.191966:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d376dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f31 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.192113:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.193676:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.193690:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.193745:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.193764:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 61 pid: 6510 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.193784:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791501312:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725943.194742:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654180 going to sleep for 11 seconds 00000100:00100000:1.0:1788725943.201829:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791501312:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725943.201867:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.202512:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.203353:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457344 00000100:00100000:2.0:1788725943.203368:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457344 00010000:00010000:2.0:1788725943.203420:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 62 pid: 6510 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.203498:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:2.0:1788725943.203511:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+62:2395:x1875614770457344:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725943.203530:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.203539:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 62 pid: 6510 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203552:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 62 pid: 6510 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203582:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d376ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f1c expref: 62 pid: 6510 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203705:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:2.0:1788725943.203712:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203724:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203732:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.203771:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.203944:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+61:2395:x1875614770457344:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 435us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.203953:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00010000:00010000:1.0:1788725943.204170:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.204179:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725943.204203:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788725943.204381:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d376dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 62 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.204415:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 61 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.204422:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.204425:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725943.204428:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725943.204461:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+61:11396:x1875614770457088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 12603us (14132us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788725943.204481:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:0.0:1788725943.211863:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.212020:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457600 00000100:00100000:3.0:1788725943.212034:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457600 00000100:00100000:3.0:1788725943.212114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788725943.212296:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+61:11396:x1875614770457600:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:3.0:1788725943.212317:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725943.212358:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37635 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f00 expref: 61 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.212395:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725943.212401:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725943.212464:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770457600:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 172us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.216835:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788725943.218091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.218250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457728 00000100:00100000:1.0:1788725943.218263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457728 00000100:00100000:1.0:1788725943.218332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:1.0:1788725943.218346:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770457728:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:1.0:1788725943.218519:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.218536:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.218548:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788725943.218652:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788725943.218739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770457728:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 396us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.218745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:0.0:1788725943.223794:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.223917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457856 00000100:00100000:3.0:1788725943.223931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457856 00000100:00100000:3.0:1788725943.224008:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:3.0:1788725943.224021:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+60:11396:x1875614770457856:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725943.224050:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725943.224077:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f38 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224377:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224392:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224417:0:6511:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224432:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224448:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725943.224478:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788725943.224484:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.224493:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045200, rc 0) 00000100:00100000:3.0:1788725943.224611:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+61:11396:x1875614770457856:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 591us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.224620:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000040:00080000:0.0:1788725943.227585:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725943.227598:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788725943.227642:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788725943.227651:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788725943.227832:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791501440:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788725943.227956:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788725943.230691:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791501440:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788725943.236874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.236950:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770457984 00000100:00100000:1.0:1788725943.236979:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770457984 00000100:00100000:1.0:1788725943.237042:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788725943.237051:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+61:11397:x1875614770457984:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788725943.237095:0:11950:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788725943.237245:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+61:11397:x1875614770457984:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 193us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.237254:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1788725943.244767:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.244906:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770458112 00000100:00100000:1.0:1788725943.244919:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770458112 00000100:00100000:1.0:1788725943.244996:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788725943.245008:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+61:11397:x1875614770458112:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788725943.245155:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245280:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245294:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245315:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245321:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245327:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245353:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245379:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245386:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725943.245444:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788725943.245450:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725943.245476:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245488:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245494:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245500:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245510:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.245515:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.245522:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246092:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:1.0:1788725943.246096:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.246101:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246149:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37700 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246287:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246294:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246300:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246305:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.246313:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246320:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246328:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9b1283234500) 00010000:00010000:1.0:1788725943.246331:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.246333:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37707 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246358:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246364:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246377:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246382:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.246385:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246390:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246399:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.246401:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.246405:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.246411:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d3770e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.246540:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+61:11397:x1875614770458112:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1530us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.246550:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1788725943.250600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.250777:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770458368 00000100:00100000:3.0:1788725943.250788:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770458368 00000100:00100000:3.0:1788725943.250872:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788725943.250884:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+61:11397:x1875614770458368:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725943.250909:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725943.250929:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37715 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f3f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251077:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251096:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251110:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725943.251159:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788725943.251257:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251283:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251288:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251291:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725943.251295:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251301:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251312:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725943.251314:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788725943.251319:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251323:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d3771c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251369:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37715 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f3f expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251380:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:3.0:1788725943.251382:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788725943.251387:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37715 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f3f expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.251397:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045800, rc 0) 00000100:00100000:3.0:1788725943.251481:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770458368:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 598us (892us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788725943.251489:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1788725943.254236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.254419:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770458496 00000100:00100000:1.0:1788725943.254430:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770458496 00000100:00100000:1.0:1788725943.254531:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1788725943.254540:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770458496:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788725943.254589:0:11950:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788725943.254738:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770458496:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 198us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.254768:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:0.0:1788725943.258361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.258424:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770458752 00000100:00100000:2.0:1788725943.258437:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770458752 00000100:00100000:2.0:1788725943.258572:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788725943.258585:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770458752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.258612:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.258616:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788725943.258652:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d376ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f23 expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.258672:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:2.0:1788725943.258679:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725943.258696:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3772a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f46 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788725943.259341:0:9522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788725943.259512:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37731 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.259537:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.259549:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.259626:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3772a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f46 expref: 64 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.259670:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f46 expref: 63 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.259938:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455600) 00010000:00010000:2.0:1788725943.259942:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725943.259945:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658600, rc 0) 00000100:00100000:2.0:1788725943.260055:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+63:11397:x1875614770458752:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1471us (1705us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788725943.260063:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788725943.263264:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.264324:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459008 00000100:00100000:1.0:1788725943.264339:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459008 00000100:00100000:1.0:1788725943.264423:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1788725943.264436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+63:11397:x1875614770459008:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788725943.264584:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725943.264616:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37731 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f46 expref: 63 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264639:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455600) 00010000:00010000:1.0:1788725943.264651:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725943.264679:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264694:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264704:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264728:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.264734:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265642:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265654:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265662:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265668:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.265673:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265682:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265697:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:1.0:1788725943.265700:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.265705:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265711:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3773f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265726:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265732:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265738:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265758:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.265761:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265767:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265775:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x7277fb2e (ffff9b1283234500) 00010000:00010000:1.0:1788725943.265778:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.265781:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.265787:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37746 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x7277fb2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.266185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770459008:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1746us (2926us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788725943.266195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1788725943.272036:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.272160:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459136 00000100:00100000:2.0:1788725943.272231:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459136 00000100:00100000:2.0:1788725943.272317:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788725943.272330:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+62:11397:x1875614770459136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.272355:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.272382:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3774d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f4d expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.272429:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.272445:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.272458:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.273520:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3774d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 64 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.273724:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 63 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.273735:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.273739:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788725943.273743:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659a00, rc 0) 00000100:00100000:2.0:1788725943.275207:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+63:11397:x1875614770459136:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2867us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.275222:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1788725943.282196:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.282277:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459392 00000100:00100000:2.0:1788725943.282298:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459392 00000100:00100000:2.0:1788725943.282377:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:2.0:1788725943.282389:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+63:11397:x1875614770459392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.282511:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.282543:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.282558:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788725943.282765:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788725943.282836:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000695450ad reply state 000000000b7290bd transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.282868:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.282878:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.282881:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788725943.282885:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725943.282996:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+65:11397:x1875614770459392:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 608us (879us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788725943.283005:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1788725943.288977:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.289971:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459520 00000100:00100000:1.0:1788725943.289986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459520 00000100:00100000:1.0:1788725943.290075:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1788725943.290089:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+65:11397:x1875614770459520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788725943.290299:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725943.290327:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f54 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.290406:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.290442:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.290482:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:1.0:1788725943.290486:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725943.290491:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a800, rc 0) 00000100:00100000:1.0:1788725943.290636:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+66:11397:x1875614770459520:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 549us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.290645:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:1.0:1788725943.295581:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.295921:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459648 00000100:00100000:2.0:1788725943.295935:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459648 00000100:00100000:2.0:1788725943.296031:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:2.0:1788725943.296045:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770459648:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788725943.296386:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770459648:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 344us (818us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788725943.296394:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00080000:1.0:1788725943.297096:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725943.301342:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.301453:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770459904 00000100:00100000:2.0:1788725943.301473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770459904 00000100:00100000:2.0:1788725943.301610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:2.0:1788725943.301623:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+66:11397:x1875614770459904:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788725943.301953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+67:11397:x1875614770459904:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 333us (625us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788725943.301962:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1788725943.309606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.310793:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460160 00000100:00100000:2.0:1788725943.310809:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460160 00000100:00100000:2.0:1788725943.310905:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:2.0:1788725943.310917:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+67:11397:x1875614770460160:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788725943.311075:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+67:11397:x1875614770460160:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 159us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.311083:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:1.0:1788725943.314826:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.315641:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460288 00000100:00100000:2.0:1788725943.315659:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460288 00000100:00100000:2.0:1788725943.315737:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:2.0:1788725943.315749:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+67:11397:x1875614770460288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.316402:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.316433:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37769 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f5b expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317246:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317269:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317342:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725943.317404:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725943.317429:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317478:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658600/0xa13c582691d37769 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f5b expref: 69 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317633:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f5b expref: 68 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.317644:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.317648:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788725943.317653:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383659200, rc 0) 00000100:00100000:2.0:1788725943.317836:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+68:11397:x1875614770460288:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2087us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.317846:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1788725943.323361:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.323460:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460416 00000100:00100000:0.0:1788725943.323481:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460416 00000100:00100000:0.0:1788725943.323637:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:0.0:1788725943.323649:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770460416:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725943.323674:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725943.323702:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f62 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725943.323733:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcab6, blocks: 0x0 00010000:00010000:0.0:1788725943.323759:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788725943.323765:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725943.323776:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.323812:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 10 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.323825:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9800, rc 0) 00000100:00100000:0.0:1788725943.323894:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+10:2396:x1875614770460416:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 247us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.323902:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788725943.329814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.329986:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460672 00000100:00100000:0.0:1788725943.330007:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460672 00000100:00100000:0.0:1788725943.330086:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:0.0:1788725943.330098:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+68:11397:x1875614770460672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788725943.330297:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+68:11397:x1875614770460672:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 200us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.330306:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:1.0:1788725943.335260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.335663:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460800 00000100:00100000:2.0:1788725943.335676:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460800 00000100:00100000:2.0:1788725943.335787:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788725943.335801:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+10:11397:x1875614770460800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.335823:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.335847:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f69 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.335885:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.335895:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725943.335900:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725943.335907:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.335989:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 11 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.336015:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 11 pid: 8427 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.336033:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1875614791501568:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725943.336203:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725943.339948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.340076:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770460928 00000100:00100000:3.0:1788725943.340088:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770460928 00010000:00010000:3.0:1788725943.340199:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 12 pid: 8427 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.340234:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:3.0:1788725943.340242:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+12:2395:x1875614770460928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725943.340256:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725943.340286:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 12 pid: 8427 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.340299:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 12 pid: 8427 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.340325:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725943.340330:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725943.340340:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.340352:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.340422:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.340440:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791501696:192.168.203.12@tcp:105: 00000100:00100000:3.0:1788725943.340684:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bbd80 going to sleep for 11 seconds 00010000:00010000:2.0:1788725943.341187:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d857bd/0xa13c582691d37777 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f62 expref: 12 pid: 8427 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.341204:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8425:1875614791501568:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725943.341234:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 11 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.341247:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1383658600, rc 0) 00000100:00100000:2.0:1788725943.341295:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+11:11397:x1875614770460800:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5497us (6048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.341303:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:3.0:1788725943.347197:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.348065:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461056 00000100:00100000:1.0:1788725943.348080:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461056 00002000:00100000:1.0:1788725943.348180:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b13af8cc380 x1875614770461056/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:339/0 lens 504/0 e 0 to 0 dl 1788725954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788725943.348194:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af8cc380 with x1875614770461056 ext(0->12) 00002000:00010000:1.0:1788725943.348201:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b13af8cc380 00000100:00100000:1.0:1788725943.348245:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:1.0:1788725943.348258:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+11:2396:x1875614770461056:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788725943.348464:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791501696:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788725943.348505:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.348628:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+11:2395:x1875614770460928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 8385us (8702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.348650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788725943.350267:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+12:2396:x1875614770461056:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1997us (3071us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788725943.350302:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:1.0:1788725943.350327:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9b13af8cc380 x1875614770461056/t4294967309(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:339/0 lens 504/448 e 0 to 0 dl 1788725954 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788725943.350339:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af8cc380 with x1875614770461056 ext(0->12) 00002000:00010000:1.0:1788725943.350346:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b13af8cc380 00000100:00100000:1.0:1788725943.352684:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.352983:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461184 00000100:00100000:0.0:1788725943.352996:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461184 00000100:00100000:0.0:1788725943.353587:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:0.0:1788725943.353603:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+68:11397:x1875614770461184:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788725943.361510:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788725943.361557:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788725943.361588:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b138769eb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788725943.361594:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13910c8e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b138769ed80 00000020:00080000:3.0:1788725943.361598:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13910c8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b1391ad1400 00000004:00080000:3.0:1788725943.361634:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788725943.361670:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b1283707240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788725943.361673:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e5c2000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283707a80 00000020:00080000:3.0:1788725943.361676:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e5c2700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b12835ba800 00000020:00080000:3.0:1788725943.361701:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788725943.361788:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788725943.361895:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725943.361917:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791501824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788725943.362014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725943.362079:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791501824 00000100:00100000:3.0:1788725943.362088:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791501824 00000100:00100000:3.0:1788725943.362179:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725943.362190:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875614791501824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788725943.362237:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788725943.362267:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.362292:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 11 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.362301:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788725943.362307:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725943.362312:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.362346:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 11 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.362364:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 11 pid: 8716 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.362377:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791501952:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725943.362451:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bbd80 going to sleep for 11 seconds 00000100:00080000:3.0:1788725943.362474:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725943.362592:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+22:11397:x1875614770461184:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 8993us (9919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.362602:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:2.0:1788725943.362683:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725943.362697:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791502080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788725943.362736:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725943.362811:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791502080 00000100:00100000:1.0:1788725943.362817:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791502080 00000100:00100000:1.0:1788725943.362898:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788725943.362908:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791502080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788725943.362939:0:8716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788725943.362967:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9dcab5, atime: 0x6a9dcab6, ctime: 0x6a9dcab5, blocks: 0x8 00010000:00010000:1.0:1788725943.362984:0:8716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.362995:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1788725943.362999:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725943.363006:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.363024:0:8716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.363034:0:8716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.363057:0:8716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.363077:0:8716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788725943.363246:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791502080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 339us (509us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788725943.363253:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:2.0:1788725943.363630:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b1283c93100/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788725943.363639:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791502080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788725943.364694:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725943.364706:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.364733:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725943.364738:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.364748:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.364771:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.364779:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3778c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.364805:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725943.364807:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725943.364809:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725943.365187:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8cd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791501952:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725943.365217:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366744:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366762:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366770:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366794:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.366800:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366808:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366827:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9b1391f3ee00) 00010000:00010000:0.0:1788725943.366831:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.366837:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366843:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658e00/0xa13c582691d37483 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366892:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366899:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366905:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366910:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.366913:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366918:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366937:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9b128220bd00) 00010000:00010000:0.0:1788725943.366940:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.366943:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366948:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d3752b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366965:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366971:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366977:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366981:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.366984:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.366990:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367007:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:0.0:1788725943.367010:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.367013:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367019:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659600/0xa13c582691d375a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367047:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367054:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367060:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367065:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.367068:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367074:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367083:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455e00) 00010000:00010000:0.0:1788725943.367085:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.367088:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367094:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659000/0xa13c582691d375cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367109:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367134:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367141:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367153:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.367156:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367162:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367171:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.367173:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.367176:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367182:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3769e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367195:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367201:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367207:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367213:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.367216:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367222:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367243:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:0.0:1788725943.367245:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788725943.367249:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.367254:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383658800/0xa13c582691d3775b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.369298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.369454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.369645:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461440 00000100:00100000:3.0:1788725943.369658:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461440 00000100:00100000:3.0:1788725943.369731:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788725943.369744:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+12:2396:x1875614770461440:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788725943.371771:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788725943.371799:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1788725943.371988:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770461440:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 2240us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.372007:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788725943.373507:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461312 00000100:00100000:2.0:1788725943.373526:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461312 00010000:00010000:2.0:1788725943.373584:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.373675:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:2.0:1788725943.373687:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab290050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770461312:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725943.373704:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.373711:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.373727:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.373778:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d37539 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ec1 expref: 7 pid: 8716 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.373798:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725943.373803:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725943.373810:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.373821:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.373872:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.373928:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab290050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770461312:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 243us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.373937:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00010000:00010000:0.0:1788725943.374030:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.374041:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.374052:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.374060:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.374083:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788725943.374345:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875614791501824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12155us (12330us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788725943.374354:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788725943.382558:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788725943.382575:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788725943.382636:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b13af8cf100 x1875614791501824/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788725959 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788725943.382652:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b13af8cf100/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788725943.382678:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791501824:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788725943.382707:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725943.382717:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.382732:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725943.382737:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.382749:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.382773:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.382781:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37785 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.382808:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725943.382810:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725943.382812:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725943.383653:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.383753:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461696 00000100:00100000:2.0:1788725943.383764:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461696 00000100:00100000:2.0:1788725943.383869:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:2.0:1788725943.383881:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+16:11397:x1875614770461696:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.383953:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.383980:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659200/0xa13c582691d37770 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f5b expref: 16 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.384015:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.384020:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725943.384089:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.384106:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.384151:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725943.384307:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035cca674 reply state 000000008f256678 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.384331:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.384337:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.384339:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725943.384342:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725943.384800:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:11397:x1875614770461696:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 918us (1151us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788725943.384809:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:1.0:1788725943.387088:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.387652:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770461824 00000100:00100000:3.0:1788725943.387664:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770461824 00000100:00100000:3.0:1788725943.387742:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788725943.387752:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770461824:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788725943.387947:0:8716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788725943.387951:0:8716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788725942 00002000:00010000:3.0:1788725943.387954:0:8716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788725942 00002000:00010000:3.0:1788725943.387956:0:8716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788725942 -> 1788725942 00002000:00010000:3.0:1788725943.387959:0:8716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788725943.388042:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770461824:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 290us (966us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788725943.388051:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:3.0:1788725943.391059:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.391266:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462080 00000100:00100000:2.0:1788725943.391280:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462080 00000100:00100000:2.0:1788725943.391535:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:2.0:1788725943.391548:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+17:11397:x1875614770462080:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788725943.391638:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.391659:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 17 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.391694:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.391741:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 17 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.391758:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 17 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.391776:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791502208:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725943.391899:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725943.395018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.395190:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791502208:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725943.395223:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.395308:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462208 00000100:00100000:0.0:1788725943.395327:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462208 00010000:00010000:0.0:1788725943.395374:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 18 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.395452:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 73 00000100:00100000:0.0:1788725943.395472:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:2396:x1875614770462208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725943.395491:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725943.395508:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 18 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395523:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 18 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395549:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1383659a00/0xa13c582691d37754 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f4d expref: 18 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395571:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:0.0:1788725943.395576:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395587:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395595:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.395624:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725943.395683:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:2396:x1875614770462208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 221us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.395689:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 73 00010000:00010000:3.0:1788725943.396606:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396620:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396673:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396681:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396688:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396694:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725943.396700:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396707:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396738:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:3.0:1788725943.396741:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788725943.396746:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.396753:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d3779a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.396838:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+16:11397:x1875614770462080:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 5289us (5853us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788725943.396848:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788725943.401069:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.401247:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462336 00000100:00100000:0.0:1788725943.401280:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462336 00000100:00100000:0.0:1788725943.401363:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788725943.401376:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770462336:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788725943.401447:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.401482:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.401500:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725943.401505:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788725943.401510:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.401558:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 7 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.401576:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 7 pid: 8425 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.401594:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791502336:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725943.401701:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.404568:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791502336:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725943.404606:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.406252:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.406410:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462464 00000100:00100000:2.0:1788725943.406422:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462464 00010000:00010000:2.0:1788725943.406483:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 8 pid: 8425 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.406532:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:2.0:1788725943.406544:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770462464:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725943.406563:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.406590:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 8 pid: 8425 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.406627:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 8 pid: 8425 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.406656:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5b5708/0xa13c582691d3777e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f69 expref: 8 pid: 8425 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.406677:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725943.406682:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725943.406689:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.406700:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.406738:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.406808:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770462464:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 265us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.406816:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00010000:00010000:3.0:1788725943.407238:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407250:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407274:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407283:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407291:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407313:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725943.407319:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407329:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407343:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.407350:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b5f2fe/0xa13c582691d377a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.407429:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770462336:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 6055us (6375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.407439:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:3.0:1788725943.411251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725943.411390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462720 00000100:00100000:0.0:1788725943.411413:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462720 00000100:00100000:0.0:1788725943.411504:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1788725943.411517:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+16:11397:x1875614770462720:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788725943.411624:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.411645:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 16 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.411656:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.411698:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 16 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.411713:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 16 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.411730:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791502464:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725943.411839:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.415862:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.415976:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462848 00000100:00100000:1.0:1788725943.415988:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462848 00010000:00010000:1.0:1788725943.416049:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 17 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.416097:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788725943.416108:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:2395:x1875614770462848:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725943.416169:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725943.416178:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 17 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416195:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 17 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416247:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.416254:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416265:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416274:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416282:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.416306:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725943.416374:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:2395:x1875614770462848:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 267us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.416382:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00010000:00010000:3.0:1788725943.417635:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f15 expref: 16 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.417662:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791502464:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725943.417689:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.417700:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.417719:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.417948:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.417962:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.417973:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.418260:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.418278:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 16 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.418295:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d39500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791502592:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725943.418407:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.419309:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725943.419341:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791502720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725943.419397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725943.419480:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791502720 00000100:00100000:2.0:1788725943.419489:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791502720 00000100:00100000:2.0:1788725943.419561:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788725943.419572:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791502720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725943.419598:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725943.419649:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791502720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.419670:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788725943.419720:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791502720:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788725943.419861:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725943.420085:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725943.420098:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791502848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725943.420154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725943.420328:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791502848 00000100:00100000:1.0:1788725943.420334:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791502848 00000100:00100000:1.0:1788725943.420365:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788725943.420373:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791502848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788725943.420387:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725943.420460:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791502848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.420476:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788725943.420933:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791502848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725943.423376:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.423445:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770462976 00000100:00100000:2.0:1788725943.423456:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770462976 00010000:00010000:2.0:1788725943.423524:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.423567:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788725943.423579:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:2396:x1875614770462976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725943.423597:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725943.423605:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.423620:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 17 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.423647:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725943.423654:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.423665:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.423673:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.423696:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725943.423767:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+17:2396:x1875614770462976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 190us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.423794:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00010000:00010000:3.0:1788725943.425017:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37762 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f54 expref: 16 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725943.425045:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d39500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791502592:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725943.425076:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.425086:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725943.425108:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788725943.425389:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788725943.425550:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788725943.425590:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788725943.425692:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d39500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875614791502976:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788725943.425822:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725943.425913:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.426296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791502976 00000100:00100000:0.0:1788725943.426305:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791502976 00000100:00100000:0.0:1788725943.426457:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788725943.426478:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1875614791502976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788725943.426607:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1875614791502976:12345-0@lo:1000:mdt00_000.0 Request processed in 140us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.426616:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788725943.426698:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d39500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875614791502976:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788725943.426864:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788725943.426948:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875614791503104:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788725943.427371:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725943.427798:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654180 going to sleep for 11 seconds 00000100:00100000:3.0:1788725943.427869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791503104 00000100:00100000:3.0:1788725943.427887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791503104 00000100:00100000:3.0:1788725943.427930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788725943.427940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6510:x1875614791503104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788725943.428136:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6510:x1875614791503104:12345-0@lo:1000:mdt00_000.0 Request processed in 177us (745us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788725943.428145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788725943.428231:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1875614791503104:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788725943.428280:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428291:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428299:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428305:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.428311:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428330:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428351:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:1.0:1788725943.428355:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725943.428362:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428368:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d377af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428399:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428405:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428423:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428428:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.428431:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428436:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428445:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.428448:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725943.428457:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428478:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428488:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.428521:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.428535:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791503232:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788725943.428621:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283654180 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.432425:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.432489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770463104 00000100:00100000:2.0:1788725943.432502:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770463104 00000100:00100000:2.0:1788725943.432568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788725943.432580:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:11396:x1875614770463104:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:1.0:1788725943.432701:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791503232:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788725943.432742:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:11396:x1875614770463104:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.432748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00010000:00010000:1.0:1788725943.432755:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.432768:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d376f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.432811:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.432827:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433197:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433212:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433219:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433226:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433233:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.433238:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433246:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433261:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.433264:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725943.433276:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433283:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d377b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433296:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433303:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433310:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433315:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725943.433318:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433325:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433334:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.433337:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788725943.433339:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.433345:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d377a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.433543:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:11397:x1875614770462720:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 22027us (22305us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788725943.433553:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000020:00080000:1.0:1788725943.433564:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788725943.433765:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725943.433770:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788725943.436567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.436651:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770463360 00000100:00100000:2.0:1788725943.436665:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770463360 00000100:00100000:2.0:1788725943.436740:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1788725943.436752:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:11396:x1875614770463360:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:2.0:1788725943.436979:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788725943.437088:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:11396:x1875614770463360:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 338us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725943.437096:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000040:00080000:0.0:1788725943.439445:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788725943.440058:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788725943.443723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.443811:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770463616 00000100:00100000:3.0:1788725943.443823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770463616 00000100:00100000:3.0:1788725943.443898:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788725943.443910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:11397:x1875614770463616:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788725943.444297:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788725943.451358:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788725943.451474:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451498:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451513:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451666:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451673:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451680:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.451709:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788725943.452184:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788725943.452193:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+21:11397:x1875614770463616:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 8276us (8476us total) trans 4294967410 rc 0/0 00010000:00010000:1.0:1788725943.452195:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.452209:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7c00 already unused, calling callback (ffffffffc0c65230) 00000100:00100000:2.0:1788725943.452213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00010000:00010000:1.0:1788725943.452216:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788725943.452222:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788725943.452229:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.452251:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:1.0:1788725943.452255:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788725943.452261:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.452268:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d377bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.452285:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725943.452287:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725943.452289:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725943.470079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725943.471307:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770463744 00000100:00100000:2.0:1788725943.471322:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770463744 00000100:00100000:2.0:1788725943.471401:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:2.0:1788725943.471414:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+21:11399:x1875614770463744:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725943.471447:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725943.471487:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d377c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f70 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472395:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472418:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472432:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472480:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472487:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.472493:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.473346:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.473372:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 22 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.473380:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.473430:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 22 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725943.473450:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 22 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725943.473477:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791503360:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725943.473637:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725943.485991:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791503360:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725943.486393:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725943.486769:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.487156:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464000 00000100:00100000:1.0:1788725943.487171:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464000 00000100:00100000:3.0:1788725943.487723:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.487766:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.487796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.487852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.487878:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725943.487901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464640 00000100:00100000:3.0:1788725943.487907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464640 00000100:00080000:3.0:1788725943.487938:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725943.487977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464256 00000100:00100000:3.0:1788725943.487980:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464256 00000100:00080000:3.0:1788725943.488190:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725943.488211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464512 00000100:00100000:3.0:1788725943.488214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464512 00000100:00080000:3.0:1788725943.488229:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725943.488247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:3.0:1788725943.488272:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770464640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725943.488394:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770464640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 135us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.488403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 279 00000100:00100000:3.0:1788725943.488424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:3.0:1788725943.488431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770464256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725943.488457:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770464256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.488463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 280 00000100:00100000:3.0:1788725943.488485:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:3.0:1788725943.488492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770464512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725943.488517:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770464512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.488619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 281 00000100:00100000:0.0:1788725943.489854:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464384 00000100:00100000:0.0:1788725943.489872:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464384 00000100:00100000:0.0:1788725943.489953:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1788725943.489966:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770464384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725943.490065:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770464384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 101us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.490090:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:0.0:1788725943.490151:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788725943.490161:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+23:6165:x1875614770464000:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788725943.490506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+24:6165:x1875614770464000:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 346us (3740us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788725943.490513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788725943.493033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725943.493282:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464768 00000100:00100000:1.0:1788725943.493296:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464768 00010000:00010000:1.0:1788725943.493353:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 24 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725943.493403:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788725943.493415:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:2395:x1875614770464768:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725943.493453:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725943.493463:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 24 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493489:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 24 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493536:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d376e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f31 expref: 24 pid: 11950 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493556:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725943.493562:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493574:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493582:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725943.493614:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725943.493830:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.493841:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725943.493922:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788725943.493928:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725943.493955:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.493971:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.493984:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.493992:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494010:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494031:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.494037:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494045:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494058:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725943.494060:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.494065:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494071:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d377cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494085:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494091:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494096:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494102:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725943.494105:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494111:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494174:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9b1283455900) 00010000:00010000:0.0:1788725943.494176:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725943.494180:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494186:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d377d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494230:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d377c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f70 expref: 24 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494246:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f70 expref: 23 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725943.494254:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725943.494256:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725943.494259:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7400, rc 0) 00000100:00100000:3.0:1788725943.494674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464128 00000100:00100000:3.0:1788725943.494689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464128 00000100:00100000:3.0:1788725943.495679:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 380 00000100:00100000:3.0:1788725943.495690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770464128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725943.498314:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+23:2395:x1875614770464768:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4881us (5276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725943.498337:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788725943.498454:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+23:11399:x1875614770463744:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 27042us (28452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725943.498474:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1788725943.498558:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770464128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2427us (10398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725943.498570:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 380 00010000:00010000:3.0:1788725944.188324:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788725944.451197:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788725944.451206:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788725944.451237:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788725944.451247:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788725944.451397:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791503488:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788725944.451526:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725944.455927:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791503488:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788725944.456367:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725944.456434:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770464896 00000100:00100000:1.0:1788725944.456441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770464896 00000100:00100000:1.0:1788725944.456506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:1.0:1788725944.456525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+22:11410:x1875614770464896:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788725944.456562:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788725944.456674:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+22:11410:x1875614770464896:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 150us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725944.456681:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1788725944.462218:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725944.462314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770465152 00000100:00100000:3.0:1788725944.462323:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770465152 00000100:00100000:3.0:1788725944.462483:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:3.0:1788725944.462496:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:11410:x1875614770465152:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725944.462518:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725944.462537:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d377e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.462652:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d377e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.462666:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d377e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.462692:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d377e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725944.462705:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788725944.462822:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d377e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f77 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.462843:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d377e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f77 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.462852:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725944.462855:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725944.462859:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:3.0:1788725944.462917:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:11410:x1875614770465152:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 425us (708us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788725944.463890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 143 00000100:00100000:0.0:1788725944.472508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725944.473339:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770465408 00000100:00100000:1.0:1788725944.473348:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770465408 00000100:00100000:1.0:1788725944.473401:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:1.0:1788725944.473410:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+24:11410:x1875614770465408:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788725944.473491:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473507:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473517:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473653:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473660:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473667:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473672:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725944.473677:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473693:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473704:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:1.0:1788725944.473707:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788725944.473711:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725944.473717:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d377f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725944.473834:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+25:11410:x1875614770465408:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 423us (1334us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788725944.473843:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000040:00080000:0.0:1788725944.474382:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725944.474387:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788725944.474905:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788725944.474915:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725944.475756:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725944.479108:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770465536 00000100:00100000:3.0:1788725944.479219:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770465536 00000100:00100000:3.0:1788725944.479293:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788725944.479303:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:2395:x1875614770465536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725944.479318:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725944.479342:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d377e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f77 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.479357:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725944.479363:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725944.479425:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+24:2395:x1875614770465536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 123us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725944.479433:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788725944.479558:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725944.480048:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770465792 00000100:00100000:3.0:1788725944.480053:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770465792 00000100:00100000:3.0:1788725944.480085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788725944.480093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+24:11410:x1875614770465792:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725944.480274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:11410:x1875614770465792:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 181us (715us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788725944.480282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000040:00080000:1.0:1788725944.516862:0:14303:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725944.516872:0:14303:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725944.516903:0:14303:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788725944.516910:0:14303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725944.651679:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725944.656717:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466048 00000100:00100000:0.0:1788725944.656731:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466048 00000100:00100000:0.0:1788725944.656798:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:0.0:1788725944.656809:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+25:11423:x1875614770466048:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725944.656832:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725944.656851:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d377fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f7e expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725944.656952:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37803 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725944.656966:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37803 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725944.656978:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37803 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725944.656989:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788725944.657082:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d377fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f7e expref: 28 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725944.657097:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37803 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f7e expref: 27 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725944.657106:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725944.657109:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788725944.657113:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9600, rc 0) 00000100:00100000:0.0:1788725944.666353:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+27:11423:x1875614770466048:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 9535us (14672us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788725944.666377:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 145 00000100:00100000:2.0:1788725944.678074:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725944.678269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466176 00000100:00100000:3.0:1788725944.678279:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466176 00000100:00100000:3.0:1788725944.678362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:3.0:1788725944.678373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:11423:x1875614770466176:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788725944.678436:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678454:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678484:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678516:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678522:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678618:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678624:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725944.678629:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678636:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678649:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:3.0:1788725944.678652:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788725944.678657:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.678663:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045000/0xa13c582691d37811 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725944.678786:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:11423:x1875614770466176:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 414us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725944.678795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 146 00000100:00100000:3.0:1788725944.784962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725944.785105:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466304 00000100:00100000:2.0:1788725944.785452:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466304 00000100:00100000:3.0:1788725944.785904:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788725944.785915:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770466304:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:3.0:1788725944.785932:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725944.785950:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046059cad/0xa13c582691d37818 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f85 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788725944.785995:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9dcab6, atime: 0x6a9dcab6, ctime: 0x6a9dcab6, blocks: 0x8 00010000:00010000:3.0:1788725944.786014:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788725944.786018:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725944.786027:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046059cad/0xa13c582691d37818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f85 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.786043:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046059cad/0xa13c582691d37818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f85 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725944.786056:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045000, rc 0) 00000100:00100000:3.0:1788725944.786108:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770466304:12345-192.168.203.12@tcp:101:cat.0 Request processed in 196us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725944.786134:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788725944.790042:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725944.790144:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466432 00000100:00100000:2.0:1788725944.790153:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466432 00002000:00100000:2.0:1788725944.790197:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9b1283c9ea00 x1875614770466432/t0(0) o3->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:340/0 lens 488/0 e 0 to 0 dl 1788725955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788725944.790208:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283c9ea00 with x1875614770466432 ext(0->4095) 00002000:00010000:2.0:1788725944.790214:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283c9ea00 00000100:00100000:2.0:1788725944.790268:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788725944.790278:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770466432:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:2.0:1788725944.790450:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770466432:12345-192.168.203.12@tcp:3:cat.0 Request processed in 172us (463us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788725944.790464:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:2.0:1788725944.790471:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9b1283c9ea00 x1875614770466432/t0(0) o3->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:340/0 lens 488/4536 e 0 to 0 dl 1788725955 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788725944.790479:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283c9ea00 with x1875614770466432 ext(0->4095) 00002000:00010000:2.0:1788725944.790482:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283c9ea00 00010000:00010000:3.0:1788725945.214171:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725945.467781:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791503616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725945.467846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788725945.468008:0:9813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390623889583ns, next at 391623886926ns, rc = 0 00000100:00100000:3.0:1788725945.468035:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791503616 00000100:00100000:3.0:1788725945.468043:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791503616 00000100:00100000:1.0:1788725945.468052:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725945.468063:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791503744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725945.468095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725945.468103:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791503744 00000100:00100000:3.0:1788725945.468108:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791503744 00000100:00100000:1.0:1788725945.468150:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788725945.468506:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791503616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725945.468544:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788725945.468606:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791503616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 447us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.468670:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791503616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725945.468991:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469056:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791504768:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469098:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788725945.469103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791503872:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469163:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791504384:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469205:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791504896:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469212:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788725945.469226:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791503744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725945.469231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788725945.469245:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788725945.469263:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504256 00000100:00100000:0.0:1788725945.469269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504256 00000100:00100000:3.0:1788725945.469301:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791503744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788725945.469313:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788725945.469318:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791504256:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788725945.469339:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725945.469362:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791504256:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469369:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788725945.469381:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469390:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504768 00000100:00100000:0.0:1788725945.469401:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504768 00000100:00100000:3.0:1788725945.469415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725945.469438:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791504512:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469440:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504896 00000100:00100000:0.0:1788725945.469445:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504896 00000100:00100000:3.0:1788725945.469476:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469486:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788725945.469495:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791504768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791505024:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725945.469554:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788725945.469555:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791504768:12345-0@lo:400:kworker.0 Request processed in 59us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725945.469563:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791504128:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469567:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788725945.469584:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788725945.469591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469594:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791504896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469611:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791504640:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469631:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791504896:12345-0@lo:400:kworker.0 Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469641:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788725945.469644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725945.469665:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469665:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791503872 00000100:00100000:0.0:1788725945.469672:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791503872 00000100:00100000:3.0:1788725945.469692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725945.469705:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788725945.469713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791503872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469717:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504000 00000100:00100000:3.0:1788725945.469722:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504000 00000100:00100000:3.0:1788725945.469745:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504512 00000100:00100000:3.0:1788725945.469749:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504512 00000100:00100000:0.0:1788725945.469750:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791503872:12345-0@lo:400:kworker.0 Request processed in 36us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469758:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788725945.469765:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505024 00000100:00100000:3.0:1788725945.469768:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505024 00000100:00100000:3.0:1788725945.469786:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504640 00000100:00100000:3.0:1788725945.469790:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504640 00000100:00100000:0.0:1788725945.469794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504384 00000100:00100000:0.0:1788725945.469800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504384 00000100:00100000:3.0:1788725945.469806:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505152 00000100:00100000:3.0:1788725945.469811:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505152 00000100:00100000:0.0:1788725945.469828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791504128 00000100:00100000:0.0:1788725945.469833:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791504128 00000100:00100000:3.0:1788725945.469836:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788725945.469847:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469853:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788725945.469861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791504384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791504384:12345-0@lo:400:kworker.0 Request processed in 45us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725945.469908:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791504000:12345-0@lo:400:kworker.0 Request processed in 63us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788725945.469934:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788725945.469943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788725945.469951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791504128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.469957:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788725945.469966:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791504512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.469986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791504128:12345-0@lo:400:kworker.0 Request processed in 35us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.469992:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788725945.470007:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791504512:12345-0@lo:400:kworker.0 Request processed in 41us (530us total) trans 0 rc 0/0 00000100:00080000:0.0:1788725945.470014:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788725945.470015:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1788725945.470019:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725945.470023:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725945.470033:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788725945.470040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788725945.470042:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791505024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791504640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.470075:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791505024:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725945.470083:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788725945.470094:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791504640:12345-0@lo:400:kworker.0 Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725945.470100:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788725945.470108:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791505152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788725945.470169:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791505152:12345-0@lo:400:kworker.0 Request processed in 61us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725945.470172:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791503872:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.470181:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788725945.470188:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791504384:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470202:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791504896:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470214:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791504256:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.470226:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791504128:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470230:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791504768:0@lo:400:kworker.0 00010000:00080000:3.0:1788725945.470244:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d95880 x1875614791504640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725945.470257:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791504640:0@lo:400:kworker.0 00010000:00080000:3.0:1788725945.470268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d95f80 x1875614791505152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725945.470276:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791505152:0@lo:400:kworker.0 00000100:00100000:0.0:1788725945.470297:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791503744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725945.470303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791504000:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.470315:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791504512:0@lo:400:kworker.0 00000100:00100000:3.0:1788725945.470326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788725945.478686:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000040:00080000:2.0:1788725945.531412:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725945.531422:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725945.531488:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788725945.531496:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788725945.916875:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788725946.237224:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725946.491653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791505280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725946.491723:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725946.492083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505280 00000100:00100000:3.0:1788725946.492091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505280 00000100:00100000:3.0:1788725946.492178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788725946.492190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791505280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725946.492232:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725946.492280:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791505280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725946.492287:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788725946.492332:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791505280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725947.259364:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725948.027982:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791505408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725948.028084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725948.028174:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505408 00000100:00100000:2.0:1788725948.028185:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505408 00000100:00100000:2.0:1788725948.028252:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788725948.028266:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791505408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725948.028299:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788725948.028393:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791505408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725948.028420:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788725948.028636:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791505408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725948.283735:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725948.539599:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725948.539633:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791505536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725948.539714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725948.540987:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505536 00000100:00100000:2.0:1788725948.540997:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505536 00000100:00100000:2.0:1788725948.541056:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788725948.541068:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725948.541069:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791505536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725948.541100:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725948.541463:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791505536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 397us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725948.541471:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788725948.541986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791505664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725948.542025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725948.542079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791505536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725948.543561:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505664 00000100:00100000:2.0:1788725948.543572:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505664 00000100:00100000:2.0:1788725948.543639:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788725948.543648:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791505664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725948.543670:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725948.543737:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791505664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725948.543744:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788725948.543788:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791505664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788725948.544503:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788725948.547184:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1788725948.548098:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791505792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788725948.548495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725948.548854:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505792 00000100:00100000:2.0:1788725948.548862:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505792 00000100:00100000:2.0:1788725948.548921:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788725948.548942:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13beba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1875614791505792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788725948.549087:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788725948.549091:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788725942 -> 1788725942 00002000:00010000:2.0:1788725948.549094:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788725942 -> 1788725942 00002000:00010000:2.0:1788725948.549096:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788725942 -> 1788725942 00002000:00010000:2.0:1788725948.549110:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788725948.550515:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13beba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1875614791505792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1569us (2014us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788725948.550525:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788725948.552798:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788725948.552859:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b1283c98a80/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788725948.552869:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791505792:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788725948.559420:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1788725948.559461:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b1283654840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788725948.559466:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b1384cb8600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283654cc0 00000020:00080000:0.0:1788725948.559470:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b1384cb8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b139e7d2c00 00000020:00080000:0.0:1788725948.559494:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788725948.559562:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788725948.559637:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788725948.560038:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560051:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560059:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560065:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725948.560070:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560079:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560096:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9b1283455f00) 00010000:00010000:2.0:1788725948.560100:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725948.560104:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725948.560110:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37793 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725948.564985:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788725948.565006:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1788725948.610946:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.611005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.611047:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466560 00000100:00100000:3.0:1788725948.611060:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466560 00000100:00100000:3.0:1788725948.611183:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 382 00000100:00100000:3.0:1788725948.611196:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2397:x1875614770466560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725948.611298:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2397:x1875614770466560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725948.611305:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 382 00000100:00100000:3.0:1788725948.611344:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466688 00000100:00100000:3.0:1788725948.611349:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466688 00000100:00100000:3.0:1788725948.611390:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00100000:3.0:1788725948.611397:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+13:2397:x1875614770466688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725948.611443:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+13:2397:x1875614770466688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725948.611450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 288 00000100:00080000:3.0:1788725948.612211:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725948.617321:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.617379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.617405:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.617439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.617767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725948.617813:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467200 00000100:00100000:3.0:1788725948.617826:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467200 00000100:00100000:3.0:1788725948.617898:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466816 00000100:00100000:3.0:1788725948.617901:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466816 00000100:00100000:3.0:1788725948.617922:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467328 00000100:00100000:3.0:1788725948.617924:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467328 00000100:00100000:3.0:1788725948.617943:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 289 00000100:00100000:3.0:1788725948.617955:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770467200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725948.618295:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770466944 00000100:00100000:1.0:1788725948.618311:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770466944 00000100:00100000:1.0:1788725948.618375:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467072 00000100:00100000:1.0:1788725948.618378:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467072 00000100:00100000:1.0:1788725948.618404:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1788725948.618415:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770466944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725948.618512:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770466944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 98us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725948.618519:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:1.0:1788725948.618535:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788725948.618542:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770467072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725948.618569:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770467072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725948.618591:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 109 00000100:00100000:1.0:1788725948.618641:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:1.0:1788725948.618651:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770466816:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725948.618680:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770466816:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725948.618686:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 290 00000100:00100000:1.0:1788725948.618701:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00100000:1.0:1788725948.618708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770467328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725948.618732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770467328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725948.618739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 291 00000100:00080000:1.0:1788725948.618760:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725948.618766:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725948.618768:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725948.618771:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725948.619704:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770467200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1745us (2318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725948.619735:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 289 00000001:00080000:2.0:1788725949.055589:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788725949.055608:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1788725949.314290:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725949.879328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725949.879432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467456 00000100:00100000:1.0:1788725949.879442:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467456 00000100:00100000:1.0:1788725949.879505:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:1.0:1788725949.879515:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11076:x1875614770467456:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788725949.879629:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11076:x1875614770467456:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725949.879636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 147 00000100:00100000:2.0:1788725949.881464:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725949.881552:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467584 00000100:00100000:1.0:1788725949.881559:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467584 00000100:00100000:1.0:1788725949.881629:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:1.0:1788725949.881639:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:11076:x1875614770467584:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788725949.881725:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:11076:x1875614770467584:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725949.881733:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 148 00000100:00100000:2.0:1788725949.884390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725949.884502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467840 00000100:00100000:3.0:1788725949.884512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467840 00000100:00100000:3.0:1788725949.884568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788725949.884589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:11076:x1875614770467840:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725949.884804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+14:11076:x1875614770467840:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 226us (423us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788725949.884812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00010000:00010000:1.0:1788725950.331337:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725950.511096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725950.511572:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770467968 00000100:00100000:0.0:1788725950.511582:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770467968 00000100:00100000:0.0:1788725950.511704:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00100000:0.0:1788725950.511715:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:11881:x1875614770467968:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:0.0:1788725950.511901:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725950.511924:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d3781f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f8c expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512007:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512022:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512034:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725950.512091:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788725950.512095:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725950.512169:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512198:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d3781f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 7 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512217:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 6 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725950.512225:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725950.512228:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725950.512232:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9800, rc 0) 00000100:00100000:0.0:1788725950.512639:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+6:11881:x1875614770467968:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 924us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725950.512647:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 149 00000100:00080000:1.0:1788725950.518645:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725950.587866:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791505920:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.587942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725950.588005:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791506432:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.588033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588201:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791505920 00000100:00100000:0.0:1788725950.588210:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791505920 00000100:00100000:0.0:1788725950.588258:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788725950.588268:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791505920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588327:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1382a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3639:x1875614791505920:12345-0@lo:400:kworker.0 Request processed in 51us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725950.588335:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788725950.588388:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791506048:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588462:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791506560:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791507072:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588540:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788725950.588547:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791506176:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588570:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588585:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791506688:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588621:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791507200:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791506304:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.588694:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.588705:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791506816:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.589173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.589196:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791507328:0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.589221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725950.589253:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506048 00000100:00100000:0.0:1788725950.589257:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506048 00000100:00100000:0.0:1788725950.589283:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506560 00000100:00100000:0.0:1788725950.589286:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506560 00000100:00100000:0.0:1788725950.589305:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507072 00000100:00100000:0.0:1788725950.589308:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507072 00000100:00100000:3.0:1788725950.589399:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791506944:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725950.589458:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791507456:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725950.589515:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3639:1875614791505920:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589542:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506432 00000100:00100000:3.0:1788725950.589545:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506432 00000100:00100000:3.0:1788725950.589570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506176 00000100:00100000:3.0:1788725950.589573:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506176 00000100:00100000:3.0:1788725950.589589:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788725950.589608:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791506432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791506432:12345-0@lo:400:kworker.0 Request processed in 45us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.589659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788725950.589674:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788725950.589680:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791506176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589715:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791506176:12345-0@lo:400:kworker.0 Request processed in 35us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.589721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788725950.589820:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506688 00000100:00100000:3.0:1788725950.589824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506688 00000100:00100000:3.0:1788725950.589842:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507200 00000100:00100000:3.0:1788725950.589845:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507200 00000100:00100000:3.0:1788725950.589857:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506304 00000100:00100000:3.0:1788725950.589860:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506304 00000100:00100000:3.0:1788725950.589873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788725950.589880:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791506048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589916:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791506048:12345-0@lo:400:kworker.0 Request processed in 36us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.589922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788725950.589934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788725950.589940:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791506560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.589965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791506560:12345-0@lo:400:kworker.0 Request processed in 25us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.589970:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788725950.589982:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788725950.589988:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791506688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.590022:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791506688:12345-0@lo:400:kworker.0 Request processed in 35us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.590028:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788725950.590040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788725950.590046:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791507200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.590072:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791507200:12345-0@lo:400:kworker.0 Request processed in 27us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.590077:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788725950.590089:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788725950.590096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791506304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725950.590297:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788725950.590304:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.590460:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725950.590470:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791507584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725950.590556:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506816 00000100:00100000:1.0:1788725950.590560:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506816 00000100:00100000:1.0:1788725950.590581:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507328 00000100:00100000:1.0:1788725950.590583:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507328 00000100:00100000:1.0:1788725950.590595:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791506944 00000100:00100000:1.0:1788725950.590598:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791506944 00000100:00100000:1.0:1788725950.590609:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507456 00000100:00100000:1.0:1788725950.590612:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507456 00000100:00100000:1.0:1788725950.590626:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788725950.590633:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791506816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.592516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725950.592565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725950.592607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725950.592659:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788725950.592672:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.592718:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791507328:12345-0@lo:400:kworker.0 Request processed in 51us (3496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725950.592735:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788725950.592756:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788725950.592763:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.592795:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791506944:12345-0@lo:400:kworker.0 Request processed in 33us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725950.592802:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788725950.592813:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788725950.592820:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.592847:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13855d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791507456:12345-0@lo:400:kworker.0 Request processed in 28us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725950.592853:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788725950.592874:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507584 00000100:00100000:2.0:1788725950.592881:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507584 00000100:00100000:1.0:1788725950.593301:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791506816:12345-0@lo:400:kworker.0 Request processed in 2666us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725950.593309:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788725950.593345:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788725950.593350:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725950.593353:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725950.593356:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725950.593599:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791506304:0@lo:400:kworker.0 00000100:00100000:1.0:1788725950.593618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791506816:0@lo:400:kworker.0 00000100:00100000:1.0:1788725950.593628:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791507328:0@lo:400:kworker.0 00000100:00100000:2.0:1788725950.593932:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507712 00000100:00100000:2.0:1788725950.593937:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507712 00000100:00100000:0.0:1788725950.594864:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875614791507072:12345-0@lo:400:kworker.0 Request processed in 4556us (6338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725950.594887:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788725950.595156:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791506304:12345-0@lo:400:kworker.0 Request processed in 5059us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725950.595163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788725950.595457:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791506176:0@lo:400:kworker.0 00010000:00080000:3.0:1788725950.595479:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d96a00 x1875614791506688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725950.595489:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791506688:0@lo:400:kworker.0 00010000:00080000:3.0:1788725950.595502:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d95f80 x1875614791507200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725950.595510:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791507200:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595522:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791506048:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595532:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791506560:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595555:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1875614791507072:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595856:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791506432:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595867:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788725950.595873:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788725950.595888:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b1283c93100, transno 4294967305 00000100:00100000:3.0:1788725950.595905:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791506944:0@lo:400:kworker.0 00000100:00100000:3.0:1788725950.595927:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788725950.595930:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b13af8cf100, transno 4294967310 00000004:00080000:3.0:1788725950.595940:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:3.0:1788725950.595959:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b1283c98a80, transno 4294967313 00000100:00100000:3.0:1788725950.595964:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791507456:0@lo:400:kworker.0 00000100:00100000:1.0:1788725950.596610:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725950.596624:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791507584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725950.596656:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788725950.596721:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791507584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725950.596741:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788725950.596758:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788725950.596765:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791507712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788725950.596775:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788725950.596799:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791507712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725950.596805:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788725950.596851:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725950.596865:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791507584:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788725951.359021:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725951.613601:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788725951.613625:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791507840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788725951.613688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725951.613900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507840 00000100:00100000:0.0:1788725951.613908:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507840 00000100:00100000:0.0:1788725951.613956:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788725951.613966:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791507840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725951.614004:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725951.614059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791507840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725951.614066:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788725951.614198:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791507840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788725952.380064:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725953.147471:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791507968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725953.147538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725953.147603:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791507968 00000100:00100000:2.0:1788725953.147612:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791507968 00000100:00100000:2.0:1788725953.147658:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788725953.147681:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791507968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725953.147712:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788725953.147770:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791507968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.147776:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788725953.147863:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791507968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788725953.404394:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725953.661150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791508096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725953.661218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725953.661595:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508096 00000100:00100000:2.0:1788725953.661604:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508096 00000100:00100000:2.0:1788725953.661660:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788725953.661671:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791508096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725953.661697:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725953.661741:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791508096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.661748:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788725953.661791:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791508096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788725953.661801:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725953.662093:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725953.662103:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725953.662155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725953.662183:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508224 00000100:00100000:3.0:1788725953.662187:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508224 00000100:00100000:3.0:1788725953.662214:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788725953.662220:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791508224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725953.662233:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725953.662269:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791508224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00080000:1.0:1788725953.662280:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725953.662291:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788725953.662331:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725953.726550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726626:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726657:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726693:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726718:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725953.726741:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468608 00000100:00100000:2.0:1788725953.726750:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468608 00000100:00100000:2.0:1788725953.726796:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468480 00000100:00100000:2.0:1788725953.726799:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468480 00000100:00100000:2.0:1788725953.726819:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788725953.726827:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770468608:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725953.726905:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770468608:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.726913:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788725953.726930:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:2.0:1788725953.726937:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770468480:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725953.726962:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770468480:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.726968:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1788725953.726983:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468352 00000100:00100000:1.0:1788725953.726987:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468352 00000100:00100000:1.0:1788725953.727025:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468864 00000100:00100000:1.0:1788725953.727028:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468864 00000100:00100000:1.0:1788725953.727042:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468224 00000100:00100000:1.0:1788725953.727044:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468224 00000100:00100000:1.0:1788725953.727066:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468736 00000100:00100000:1.0:1788725953.727069:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468736 00000100:00100000:1.0:1788725953.727084:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:1.0:1788725953.727091:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770468352:12345-192.168.203.12@tcp:400:kworker.0 00000100:00080000:2.0:1788725953.727100:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725953.727103:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725953.727106:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725953.727107:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725953.727152:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770468352:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 61us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.727156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:1.0:1788725953.727159:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 298 00000100:00100000:2.0:1788725953.727162:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770468864:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725953.727171:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:2.0:1788725953.727187:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770468864:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725953.727188:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+14:2398:x1875614770468224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725953.727193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 299 00000100:00100000:2.0:1788725953.727206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:2.0:1788725953.727212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2398:x1875614770468736:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725953.727214:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+14:2398:x1875614770468224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725953.727220:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 300 00000100:00100000:2.0:1788725953.727230:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2398:x1875614770468736:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 18us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725953.727236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 301 00000100:00100000:3.0:1788725953.729071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770468096 00000100:00100000:3.0:1788725953.729083:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770468096 00000100:00100000:3.0:1788725953.729172:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 384 00000100:00100000:3.0:1788725953.729182:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770468096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725953.729243:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770468096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 63us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725953.729250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 384 00010000:00010000:3.0:1788725954.428734:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788725954.698911:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788725954.698980:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788725954.699176:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788725954.699191:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1788725954.822443:0:14501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:19:12 (1788725952) 00000040:00080000:2.0:1788725955.131997:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788725955.451396:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725955.707770:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725955.707791:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791508352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725955.707871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725955.707940:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508352 00000100:00100000:1.0:1788725955.707947:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508352 00000100:00100000:1.0:1788725955.708004:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788725955.708014:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791508352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788725955.708058:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788725955.708134:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791508352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725955.708143:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788725955.708195:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791508352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725955.708767:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725955.708780:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791508480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725955.708817:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725955.708900:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508480 00000100:00100000:3.0:1788725955.708906:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508480 00000100:00100000:3.0:1788725955.708946:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788725955.708955:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791508480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725955.708968:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788725955.709015:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791508480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725955.709023:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788725955.709077:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791508480:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788725955.709815:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725955.709956:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791508864:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725955.710037:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791509376:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725955.710092:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791509888:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725955.710165:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788725955.710171:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791508992:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725955.710211:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791509504:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725955.710255:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508864 00000100:00100000:2.0:1788725955.710260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508864 00000100:00100000:2.0:1788725955.710293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788725955.710301:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710341:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791508864:12345-0@lo:400:kworker.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725955.710348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788725955.710365:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509376 00000100:00100000:2.0:1788725955.710368:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509376 00000100:00100000:2.0:1788725955.710542:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509888 00000100:00100000:2.0:1788725955.710546:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509888 00000100:00100000:2.0:1788725955.710564:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508992 00000100:00100000:2.0:1788725955.710567:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508992 00000100:00100000:2.0:1788725955.710578:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788725955.710584:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710616:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791509376:12345-0@lo:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725955.710631:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788725955.710644:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788725955.710650:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791509888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710677:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791509888:12345-0@lo:400:kworker.0 Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725955.710682:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788725955.710694:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788725955.710699:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710721:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791508992:12345-0@lo:400:kworker.0 Request processed in 22us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725955.710727:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788725955.710749:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509504 00000100:00100000:2.0:1788725955.710752:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509504 00000100:00100000:2.0:1788725955.710775:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788725955.710781:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710809:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791509504:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725955.710816:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788725955.710835:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788725955.710838:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725955.710862:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791508992:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710872:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791509504:0@lo:400:kworker.0 00000100:00100000:2.0:1788725955.710880:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791508864:0@lo:400:kworker.0 00010000:00080000:2.0:1788725955.710891:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635c00 x1875614791509376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725955.710908:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791509376:0@lo:400:kworker.0 00010000:00080000:2.0:1788725955.710919:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283caf100 x1875614791509888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725955.710926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791509888:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711331:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791508736:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711410:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791509248:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711448:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791509760:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711522:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788725955.711529:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791508608:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711558:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711591:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791509120:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711615:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711632:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791509632:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725955.711682:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508736 00000100:00100000:0.0:1788725955.711687:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508736 00000100:00100000:0.0:1788725955.711712:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509248 00000100:00100000:0.0:1788725955.711715:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509248 00000100:00100000:0.0:1788725955.711733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509760 00000100:00100000:0.0:1788725955.711736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509760 00000100:00100000:0.0:1788725955.711750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788725955.711757:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711799:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791508736:12345-0@lo:400:kworker.0 Request processed in 41us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725955.711806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788725955.711822:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788725955.711828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791509248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711852:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791509248:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725955.711859:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788725955.711869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788725955.711875:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791509760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.711899:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791509760:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725955.711906:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788725955.711926:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791508608 00000100:00100000:0.0:1788725955.711929:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791508608 00000100:00100000:0.0:1788725955.711960:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788725955.711966:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791508608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.712012:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791508608:12345-0@lo:400:kworker.0 Request processed in 46us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725955.712018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788725955.713429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509120 00000100:00100000:0.0:1788725955.713443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509120 00000100:00100000:1.0:1788725955.713597:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791509632 00000100:00100000:1.0:1788725955.713602:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791509632 00000100:00100000:1.0:1788725955.713643:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788725955.713653:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791509632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725955.713718:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791509632:12345-0@lo:400:kworker.0 Request processed in 66us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725955.713725:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788725955.713826:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725955.713831:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725955.713862:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791508608:0@lo:400:kworker.0 00000100:00100000:1.0:1788725955.713880:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791509632:0@lo:400:kworker.0 00000100:00100000:1.0:1788725955.713894:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791508736:0@lo:400:kworker.0 00000100:00100000:1.0:1788725955.713905:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791509248:0@lo:400:kworker.0 00000100:00100000:1.0:1788725955.713917:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791509760:0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.714278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788725955.714290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791509120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725955.714343:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138422c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791509120:12345-0@lo:400:kworker.0 Request processed in 57us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725955.714350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788725955.714495:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791509120:0@lo:400:kworker.0 00000040:00080000:1.0:1788725955.771341:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725955.771350:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725955.771459:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788725955.771467:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788725956.475915:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725956.732421:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788725956.732447:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791510016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725956.732520:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725956.732649:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791510016 00000100:00100000:0.0:1788725956.732657:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791510016 00000100:00100000:0.0:1788725956.732710:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788725956.732720:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791510016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788725956.732754:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788725956.732804:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791510016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725956.732810:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788725956.732993:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791510016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725957.026035:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725957.026279:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469120 00000100:00100000:0.0:1788725957.026298:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469120 00000100:00100000:0.0:1788725957.026391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00100000:0.0:1788725957.026403:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:12148:x1875614770469120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725957.026424:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725957.026443:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d3782d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f93 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026538:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026552:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026564:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026589:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026596:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026604:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026702:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37842 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026710:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37842 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026718:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37842 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725957.026728:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788725957.026800:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026808:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026833:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026839:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725957.026843:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026850:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026862:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283237c00) 00010000:00010000:0.0:1788725957.026865:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725957.026869:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026876:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37834 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026890:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026895:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026900:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026904:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725957.026907:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026924:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026934:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b1394485e00) 00010000:00010000:0.0:1788725957.026936:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725957.026939:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.026946:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d3783b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.027255:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d3782d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f93 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.027271:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37842 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f93 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725957.027279:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725957.027281:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725957.027283:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8a00, rc 0) 00000100:00100000:0.0:1788725957.027339:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+15:12148:x1875614770469120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 939us (1313us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788725957.027347:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 150 00000100:00080000:1.0:1788725957.027764:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788725957.034333:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725957.034439:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469248 00000100:00100000:1.0:1788725957.034449:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469248 00000100:00100000:1.0:1788725957.034515:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788725957.034525:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab291450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+15:2397:x1875614770469248:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725957.034540:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725957.034567:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37842 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f93 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725957.034586:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:1.0:1788725957.034591:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725957.034648:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab291450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+14:2397:x1875614770469248:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.034656:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788725957.038055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725957.038160:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469376 00000100:00100000:2.0:1788725957.038171:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469376 00000100:00100000:2.0:1788725957.038238:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:2.0:1788725957.038248:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+14:12148:x1875614770469376:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788725957.038350:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+14:12148:x1875614770469376:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725957.038357:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 151 00000100:00100000:2.0:1788725957.041753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725957.041845:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469504 00000100:00100000:1.0:1788725957.041855:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469504 00000100:00100000:1.0:1788725957.041932:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00100000:1.0:1788725957.041944:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12837f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:12148:x1875614770469504:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788725957.042045:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12837f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:12148:x1875614770469504:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725957.042053:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 152 00000100:00080000:2.0:1788725957.042816:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1788725957.180034:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788725957.504749:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788725957.819588:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725957.819600:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725957.820191:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788725957.820206:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725958.268493:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725958.268532:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791510144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725958.268620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725958.268706:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791510144 00000100:00100000:1.0:1788725958.268716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791510144 00000100:00100000:1.0:1788725958.268773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788725958.268783:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791510144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725958.268826:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788725958.268879:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791510144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725958.268887:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788725958.268934:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791510144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725958.525305:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725958.779621:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725958.779644:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791510272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725958.779799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725958.779832:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791510400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725958.779866:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791510272 00000100:00100000:0.0:1788725958.779873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725958.779889:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791510272 00000100:00100000:3.0:1788725958.784663:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791510400 00000100:00100000:0.0:1788725958.784734:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788725958.784756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791510272:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788725958.784774:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725958.784811:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791510400 00002000:00000024:0.0:1788725958.784816:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725958.784906:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788725958.784914:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791510400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788725958.784928:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725958.784972:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791510272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 225us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725958.784979:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791510400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (5104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725958.784985:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788725958.784994:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788725958.785048:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791510400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788725958.785050:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725958.785094:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791510272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725958.845707:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725958.845759:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725958.845796:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469888 00000100:00100000:2.0:1788725958.845804:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469888 00000100:00100000:2.0:1788725958.845854:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 308 00000100:00100000:2.0:1788725958.845864:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770469888:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725958.845946:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2395:x1875614770469888:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725958.845954:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 308 00000100:00100000:3.0:1788725958.847172:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469632 00000100:00100000:3.0:1788725958.847305:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469632 00000100:00100000:3.0:1788725958.847356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 386 00000100:00100000:3.0:1788725958.847373:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770469632:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725958.847430:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770469632:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725958.847437:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 386 00000100:00100000:2.0:1788725958.853212:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725958.853243:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470144 00000100:00100000:2.0:1788725958.853251:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470144 00000100:00100000:2.0:1788725958.853302:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:2.0:1788725958.853310:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770470144:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725958.853380:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770470144:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725958.853387:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00080000:2.0:1788725958.853405:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725958.854920:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725958.854945:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725958.854964:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725958.855791:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725958.855820:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470016 00000100:00100000:3.0:1788725958.855827:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470016 00000100:00100000:3.0:1788725958.855881:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:3.0:1788725958.855890:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770470016:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725958.855959:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770470016:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725958.855967:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1788725958.856102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770469760 00000100:00100000:0.0:1788725958.856108:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770469760 00000100:00100000:0.0:1788725958.856167:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470272 00000100:00100000:0.0:1788725958.856170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470272 00000100:00100000:0.0:1788725958.856200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470400 00000100:00100000:0.0:1788725958.856203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470400 00000100:00100000:0.0:1788725958.856220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 309 00000100:00100000:0.0:1788725958.856227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:2396:x1875614770469760:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725958.856258:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:2396:x1875614770469760:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725958.856264:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 309 00000100:00100000:0.0:1788725958.856283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 310 00000100:00100000:0.0:1788725958.856290:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2396:x1875614770470272:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725958.856310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2396:x1875614770470272:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725958.856317:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 310 00000100:00100000:0.0:1788725958.856326:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00100000:0.0:1788725958.856332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770470400:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725958.856378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770470400:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 46us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725958.856384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 311 00000100:00080000:2.0:1788725958.860769:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725958.860777:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725958.860780:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725959.548582:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725959.548773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470528 00000100:00100000:0.0:1788725959.548783:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470528 00000100:00100000:0.0:1788725959.548846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00100000:0.0:1788725959.548856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:12191:x1875614770470528:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725959.548876:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725959.548895:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6f9a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.548958:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.548973:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.548982:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.548996:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549002:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549008:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549052:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549065:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549072:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549078:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725959.549082:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549089:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549100:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725959.549103:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725959.549107:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549112:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549140:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549146:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549151:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549157:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725959.549168:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549174:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549183:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b1394485e00) 00010000:00010000:0.0:1788725959.549185:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725959.549188:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549193:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3785e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549224:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37850 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f9a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549234:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:0.0:1788725959.549236:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725959.549239:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f9a expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.549247:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8400, rc 0) 00000100:00100000:0.0:1788725959.549307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+14:12191:x1875614770470528:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 452us (734us total) trans 0 rc 301/301 00000100:00100000:0.0:1788725959.549315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 153 00000100:00080000:0.0:1788725959.549338:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788725959.550162:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725959.557022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725959.557553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470784 00000100:00100000:3.0:1788725959.557563:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470784 00000100:00100000:3.0:1788725959.557633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1788725959.557643:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+14:12191:x1875614770470784:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:3.0:1788725959.558515:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725959.558544:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6aea00/0xa13c582691d371a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dbe expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725959.558561:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:3.0:1788725959.558566:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725959.558636:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725959.558650:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 5 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725959.558660:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725959.558822:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 5 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725959.558837:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 5 pid: 9522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725959.558851:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791510528:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725959.558941:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788725959.562347:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791510528:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725959.562384:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725959.563001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.563174:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770470912 00000100:00100000:1.0:1788725959.563182:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770470912 00010000:00010000:1.0:1788725959.563219:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 6 pid: 9522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725959.563256:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788725959.563266:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2396:x1875614770470912:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725959.563278:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725959.563285:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 6 pid: 9522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563296:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 6 pid: 9522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563331:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37826 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f8c expref: 6 pid: 9522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563346:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:1.0:1788725959.563351:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563371:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563379:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563404:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725959.563450:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770470912:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 185us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725959.563457:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00010000:00010000:1.0:1788725959.563481:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563488:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563510:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563519:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.563527:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565397:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565418:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565428:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725959.565444:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004408c398 reply state 0000000079b704be transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565456:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565463:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725959.565466:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725959.565469:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788725959.565474:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788725959.565482:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565488:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565494:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565500:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725959.565505:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565524:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565534:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1382afe300) 00010000:00010000:1.0:1788725959.565536:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725959.565540:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565546:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37865 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725959.565564:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004408c398 reply state 0000000079b704be transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565572:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.565577:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b1283234900) 00010000:00010000:1.0:1788725959.565580:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725959.565582:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788725959.565765:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+15:12191:x1875614770470784:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 8120us (8748us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788725959.565774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 154 00000100:00100000:3.0:1788725959.662635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.662797:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471040 00000100:00100000:1.0:1788725959.662807:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471040 00000100:00100000:1.0:1788725959.662872:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:1.0:1788725959.662883:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+15:12199:x1875614770471040:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:1.0:1788725959.662917:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725959.662940:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d3787a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fa1 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663015:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663028:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663039:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725959.663081:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788725959.663085:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725959.663107:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663169:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d3787a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa1 expref: 17 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663187:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa1 expref: 16 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.663195:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:1.0:1788725959.663197:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725959.663200:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b200, rc 0) 00000100:00100000:1.0:1788725959.663268:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+16:12199:x1875614770471040:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 387us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725959.663275:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 155 00000100:00100000:3.0:1788725959.741206:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725959.741414:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471168 00000100:00100000:0.0:1788725959.741425:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471168 00000100:00100000:0.0:1788725959.741487:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:0.0:1788725959.741520:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+16:12205:x1875614770471168:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725959.741541:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725959.741561:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fa8 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741636:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741649:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741659:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741855:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741864:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741872:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741958:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741968:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.741975:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725959.742018:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788725959.742022:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725959.742040:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742053:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742059:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742066:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742073:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725959.742078:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742087:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742099:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:0.0:1788725959.742102:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725959.742107:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742113:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d3788f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742158:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742175:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742182:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742187:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725959.742191:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742197:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742206:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b1283234900) 00010000:00010000:0.0:1788725959.742209:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725959.742212:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742218:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37896 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742244:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa8 expref: 18 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742256:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa8 expref: 17 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.742263:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725959.742266:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788725959.742273:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8200, rc 0) 00000100:00100000:0.0:1788725959.742386:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+17:12205:x1875614770471168:12345-192.168.203.12@tcp:101:bash.0 Request processed in 867us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725959.742393:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 156 00000100:00100000:3.0:1788725959.747933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.748021:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471424 00000100:00100000:1.0:1788725959.748030:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471424 00000100:00100000:1.0:1788725959.748102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:1.0:1788725959.748113:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+17:12205:x1875614770471424:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725959.748159:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725959.748180:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d378a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6faf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748275:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748288:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748299:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748312:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748320:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748326:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788725959.748634:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788725959.748761:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748770:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748778:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748817:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748825:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748832:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748838:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725959.748842:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748849:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748861:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725959.748864:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725959.748869:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748875:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d378ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725959.748888:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af9a28da reply state 00000000163f6dc2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748898:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748904:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283234f00) 00010000:00010000:1.0:1788725959.748912:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725959.748915:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788725959.748945:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d378a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748958:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.748965:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:1.0:1788725959.748967:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788725959.748969:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725959.749035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:12205:x1875614770471424:12345-192.168.203.12@tcp:101:bash.0 Request processed in 924us (1111us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788725959.749041:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:2.0:1788725959.755975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725959.756413:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471552 00000100:00100000:0.0:1788725959.756425:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471552 00000100:00100000:0.0:1788725959.756496:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788725959.756506:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2398:x1875614770471552:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725959.756525:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725959.756546:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fb6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788725959.756569:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788725959.756587:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1788725959.756592:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725959.756601:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.756631:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 6 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725959.756644:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8400, rc 0) 00000100:00100000:0.0:1788725959.756714:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2398:x1875614770471552:12345-192.168.203.12@tcp:101:bash.0 Request processed in 208us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725959.756721:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788725959.761668:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.761768:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471680 00000100:00100000:1.0:1788725959.761778:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471680 00000100:00100000:1.0:1788725959.761834:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788725959.761844:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+6:12205:x1875614770471680:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725959.761861:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725959.761878:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fbd expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.761919:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.761928:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725959.761932:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725959.761938:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.761986:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.762001:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725959.762016:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791510656:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725959.762144:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788725959.765070:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8426:1875614791510656:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725959.765108:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.765168:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fc00, rc 0) 00000100:00100000:1.0:1788725959.765235:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+7:12205:x1875614770471680:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3392us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725959.765245:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:3.0:1788725959.768981:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.769195:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770471808 00000100:00100000:1.0:1788725959.769205:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770471808 00010000:00010000:1.0:1788725959.769254:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725959.769295:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788725959.769305:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770471808:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725959.769330:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725959.769350:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.769638:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.769661:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bc42f78/0xa13c582691d378c7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fb6 expref: 7 pid: 8425 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.769677:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725959.769681:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725959.769689:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.769699:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.769738:0:10330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725959.769754:0:10330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10330:1875614791510784:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788725959.769834:0:10330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788725959.784820:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725959.784985:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770472064 00000100:00100000:0.0:1788725959.784995:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770472064 00000100:00100000:0.0:1788725959.785066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788725959.785077:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:12205:x1875614770472064:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:0.0:1788725959.785411:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+21:12205:x1875614770472064:12345-192.168.203.12@tcp:35:bash.0 Request processed in 335us (599us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788725959.785418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788725959.785498:0:10330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10330:1875614791510784:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788725959.785524:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725959.785552:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2396:x1875614770471808:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 16249us (16582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725959.785560:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788725959.894628:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725959.894718:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770472320 00000100:00100000:1.0:1788725959.894727:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770472320 00000100:00100000:1.0:1788725959.894784:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:1.0:1788725959.894794:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+21:12215:x1875614770472320:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725959.894817:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725959.894837:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d378d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fc4 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725959.894936:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788725959.895024:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d378d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fc4 expref: 23 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.895038:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:1.0:1788725959.895041:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725959.895046:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d378d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fc4 expref: 23 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725959.895059:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788725959.895161:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+22:12215:x1875614770472320:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 323us (498us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788725959.895169:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:2.0:1788725959.899272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725959.899317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770472576 00000100:00100000:0.0:1788725959.899328:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770472576 00000100:00100000:0.0:1788725959.899402:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788725959.899413:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:12215:x1875614770472576:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788725959.899631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+23:12215:x1875614770472576:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 220us (368us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788725959.899639:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788725960.005750:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725960.005934:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770472704 00000100:00100000:0.0:1788725960.005944:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770472704 00000100:00100000:0.0:1788725960.006002:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:0.0:1788725960.006012:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+23:12221:x1875614770472704:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725960.006036:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725960.006056:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d378e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fcb expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006165:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006181:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006194:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725960.006261:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788725960.006265:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725960.006284:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006309:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d378e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fcb expref: 25 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006326:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fcb expref: 24 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.006334:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725960.006338:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725960.006341:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9a00, rc 0) 00000100:00100000:0.0:1788725960.006414:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:12221:x1875614770472704:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 402us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.006421:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:2.0:1788725960.010589:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.010680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770472960 00000100:00100000:3.0:1788725960.010691:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770472960 00000100:00100000:3.0:1788725960.010752:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:3.0:1788725960.010763:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:12221:x1875614770472960:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725960.010782:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725960.010801:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d378f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fd2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.010916:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d378f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.010931:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d378f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.010943:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d378f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725960.010954:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788725960.011071:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d378f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd2 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.011091:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d378f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd2 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.011101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:3.0:1788725960.011104:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725960.011108:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:3.0:1788725960.011202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+26:12221:x1875614770472960:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 441us (623us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788725960.011278:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788725960.015425:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.015699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473344 00000100:00100000:3.0:1788725960.015709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473344 00000100:00100000:3.0:1788725960.015772:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788725960.015782:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+26:2398:x1875614770473344:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725960.015798:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725960.015822:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d378f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd2 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.015842:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:3.0:1788725960.015847:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725960.016035:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+25:2398:x1875614770473344:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 252us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.016043:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788725960.018336:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.020016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473216 00000100:00100000:3.0:1788725960.020030:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473216 00000100:00100000:3.0:1788725960.020147:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:3.0:1788725960.020158:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:12221:x1875614770473216:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725960.020181:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725960.020200:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37906 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fd9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.020317:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.020332:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.020343:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725960.020365:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788725960.020460:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37906 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd9 expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.020478:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd9 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.020487:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:3.0:1788725960.020502:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788725960.020506:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044a00, rc 0) 00000100:00100000:3.0:1788725960.020568:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+27:12221:x1875614770473216:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 412us (2239us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788725960.020576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:1.0:1788725960.029328:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.029475:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473472 00000100:00100000:3.0:1788725960.029497:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473472 00000100:00100000:3.0:1788725960.029562:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788725960.029573:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+6:2397:x1875614770473472:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:3.0:1788725960.029612:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.029632:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.029640:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788725960.029645:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725960.029650:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.029687:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.029701:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 6 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725960.029714:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1875614791510912:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725960.029797:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788725960.030732:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725960.032027:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1875614791510912:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725960.032066:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725960.033580:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.033913:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473600 00000100:00100000:3.0:1788725960.033923:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473600 00002000:00100000:3.0:1788725960.033972:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b1283c99500 x1875614770473600/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:356/0 lens 504/0 e 0 to 0 dl 1788725971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725960.033983:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283c99500 with x1875614770473600 ext(0->12) 00010000:00010000:3.0:1788725960.034004:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 7 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.034020:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 7 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788725960.034028:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b1283c99500 00000100:00100000:3.0:1788725960.034063:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788725960.034074:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770473600:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:3.0:1788725960.035107:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770473600:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1027us (1529us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788725960.035138:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00002000:00100000:3.0:1788725960.035148:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9b1283c99500 x1875614770473600/t4294967306(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:356/0 lens 504/448 e 0 to 0 dl 1788725971 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725960.035158:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283c99500 with x1875614770473600 ext(0->12) 00010000:00010000:3.0:1788725960.035166:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.035180:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788725960.035188:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b1283c99500 00000100:00100000:3.0:1788725960.037767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725960.038087:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473728 00000100:00100000:0.0:1788725960.038096:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473728 00010000:00010000:0.0:1788725960.038159:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725960.038254:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788725960.038265:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770473728:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725960.038280:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788725960.038295:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788725960.038310:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788725959 00002000:00010000:0.0:1788725960.038313:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788725959 00002000:00010000:0.0:1788725960.038315:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788725959 00002000:00010000:0.0:1788725960.038318:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788725960.038325:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.038339:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.038376:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086bdd0de/0xa13c582691d378ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fbd expref: 9 pid: 8426 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.038393:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788725960.038397:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788725960.038403:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.038413:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.038441:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725960.038487:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770473728:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 224us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.038506:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00010000:00010000:3.0:1788725960.038565:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038587:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038606:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038615:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038624:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038633:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725960.038637:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038647:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038660:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.038668:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6edf933/0xa13c582691d3791b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725960.038723:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770473472:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 9152us (9405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.038732:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:3.0:1788725960.043088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725960.043384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770473984 00000100:00100000:1.0:1788725960.043394:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770473984 00000100:00100000:1.0:1788725960.043450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788725960.043460:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:12221:x1875614770473984:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:1.0:1788725960.043530:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd9 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725960.043735:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788725960.043766:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788725960.044038:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788725960.044073:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.044087:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.044095:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.044159:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.044172:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 31 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725960.044200:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875614791511040:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725960.044553:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a9683f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725960.048023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725960.048110:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c98700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1875614791511040:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725960.048164:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725960.049479:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770474112 00000100:00100000:3.0:1788725960.049490:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770474112 00010000:00010000:3.0:1788725960.049543:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 32 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725960.049583:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:3.0:1788725960.049592:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+32:2395:x1875614770474112:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725960.049607:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725960.049615:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 32 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049627:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 32 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049649:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d378b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6faf expref: 32 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049664:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:3.0:1788725960.049669:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049678:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049696:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.049862:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725960.049928:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+31:2395:x1875614770474112:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 335us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.049937:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00010000:00010000:0.0:1788725960.051033:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.051046:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788725960.051422:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788725960.052010:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788725960.052109:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875614791511168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788725960.052204:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.052314:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788725960.052643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511168 00000100:00100000:2.0:1788725960.052652:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511168 00000100:00100000:2.0:1788725960.052731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788725960.052741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875614791511168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788725960.052837:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1875614791511168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.052846:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:1.0:1788725960.053004:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725960.053066:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875614791511168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788725960.053453:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788725960.053525:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875614791511296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788725960.053561:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.053587:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a9683f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725960.053686:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511296 00000100:00100000:0.0:1788725960.053691:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511296 00000100:00100000:0.0:1788725960.053731:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788725960.053740:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1875614791511296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788725960.053855:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6514:x1875614791511296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (292us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788725960.053862:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788725960.053988:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1875614791511296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788725960.054028:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788725960.054060:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054070:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054077:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054083:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725960.054088:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054096:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054112:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:1.0:1788725960.054217:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788725960.054234:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.054242:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37922 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788725960.054466:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788725960.054667:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788725960.054679:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405210561014ns, next at 406210558698ns, rc = 0 00000001:00080000:1.0:1788725960.054685:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788725960.054708:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1283234200) 00010000:00010000:1.0:1788725960.054711:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788725960.054718:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3790d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fd9 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725960.054855:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+34:12221:x1875614770473984:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 11395us (11775us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788725960.054863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000020:00080000:1.0:1788725960.054867:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788725960.058774:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.058862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770474240 00000100:00100000:3.0:1788725960.058871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770474240 00000100:00100000:3.0:1788725960.059013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:3.0:1788725960.059024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+34:12221:x1875614770474240:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725960.059046:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725960.059068:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37929 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fe0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.059159:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37929 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fe0 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.059174:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37929 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fe0 expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.059193:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725960.059197:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788725960.059200:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380031a00, rc 0) 00000100:00100000:3.0:1788725960.059447:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+35:12221:x1875614770474240:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 423us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.059454:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:2.0:1788725960.063234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.063368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770474496 00000100:00100000:3.0:1788725960.063378:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770474496 00000100:00100000:3.0:1788725960.063476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788725960.063487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+35:12221:x1875614770474496:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725960.063712:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+36:12221:x1875614770474496:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 226us (487us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788725960.063720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788725960.226856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725960.227000:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770474752 00000100:00100000:2.0:1788725960.227010:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770474752 00000100:00100000:2.0:1788725960.227068:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1788725960.227079:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+36:12231:x1875614770474752:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725960.227103:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725960.227175:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6c00/0xa13c582691d37930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fe7 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725960.227274:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788725960.227382:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6c00/0xa13c582691d37930 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fe7 expref: 38 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725960.227395:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:2.0:1788725960.227398:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788725960.227403:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6c00/0xa13c582691d37930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fe7 expref: 38 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725960.227417:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6c00, rc 0) 00000100:00100000:2.0:1788725960.227483:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+37:12231:x1875614770474752:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 406us (638us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788725960.227507:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1788725960.235085:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.235195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770474880 00000100:00100000:3.0:1788725960.235205:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770474880 00000100:00100000:3.0:1788725960.235267:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1788725960.235277:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:12231:x1875614770474880:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:3.0:1788725960.235344:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235375:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235388:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235398:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235405:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235412:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235484:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235505:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235512:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788725960.235558:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235571:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235577:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235584:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235590:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1380031000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725960.235593:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235599:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235611:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725960.235614:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725960.235618:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235624:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d3793e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235644:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235650:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235655:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235661:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1380030400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725960.235664:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235670:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235678:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283234f00) 00010000:00010000:3.0:1788725960.235680:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725960.235684:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235689:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235699:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235705:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235712:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235722:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725960.235725:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235730:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235738:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725960.235740:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725960.235743:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.235749:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d3794c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725960.235823:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:12231:x1875614770474880:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 547us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.235831:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 164 00000100:00100000:3.0:1788725960.238718:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725960.242008:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770475136 00000100:00100000:1.0:1788725960.242022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770475136 00000100:00100000:1.0:1788725960.242146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788725960.242157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+37:12231:x1875614770475136:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788725960.242405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+38:12231:x1875614770475136:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 248us (3694us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788725960.242412:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788725960.341739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.341839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770475392 00000100:00100000:3.0:1788725960.341848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770475392 00000100:00100000:3.0:1788725960.341918:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:3.0:1788725960.341928:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+38:12234:x1875614770475392:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725960.341957:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725960.341977:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37953 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6fee expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342049:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342068:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342079:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342091:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342098:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342104:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342252:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342262:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342270:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725960.342279:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788725960.342350:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342368:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342375:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342386:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725960.342390:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342397:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342410:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725960.342413:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725960.342417:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342423:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d3795a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342942:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342951:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342957:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342963:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725960.342966:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342973:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.342995:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283234f00) 00010000:00010000:3.0:1788725960.342998:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725960.343001:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.343008:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37961 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.343052:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37953 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.343065:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 40 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.343073:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725960.343076:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725960.343079:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:3.0:1788725960.343673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+40:12234:x1875614770475392:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1743us (1940us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788725960.343683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:2.0:1788725960.346983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725960.347068:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770475520 00000100:00100000:0.0:1788725960.347077:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770475520 00000100:00100000:0.0:1788725960.347176:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1788725960.347187:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+40:12234:x1875614770475520:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788725960.347248:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347276:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347287:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347320:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347326:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347613:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347619:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725960.347624:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347632:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347645:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725960.347648:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725960.347653:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.347659:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37976 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725960.347811:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+40:12234:x1875614770475520:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 624us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.347826:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 166 00000100:00100000:0.0:1788725960.362062:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.365009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770475776 00000100:00100000:3.0:1788725960.365025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770475776 00000100:00100000:3.0:1788725960.365246:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:3.0:1788725960.365258:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+40:12234:x1875614770475776:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725960.366646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:12234:x1875614770475776:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 1381us (4584us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788725960.366659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00010000:00010000:3.0:1788725960.571402:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725960.827525:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791511680:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.828157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791512192:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.828211:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791512704:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828234:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.828258:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788725960.828265:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791511552:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828287:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.828303:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791512064:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725960.828344:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791512576:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.828376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725960.828514:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511680 00000100:00100000:2.0:1788725960.828522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511680 00000100:00100000:2.0:1788725960.828582:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788725960.828602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791511680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.828659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791511680:12345-0@lo:400:kworker.0 Request processed in 59us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.828667:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788725960.828784:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512704 00000100:00100000:2.0:1788725960.828788:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512704 00000100:00100000:2.0:1788725960.828825:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725960.828832:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791512704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.828863:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791512704:12345-0@lo:400:kworker.0 Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.828870:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788725960.828910:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791511680:0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.828921:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791512704:0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.828950:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512192 00000100:00100000:2.0:1788725960.828954:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512192 00000100:00100000:2.0:1788725960.828979:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511552 00000100:00100000:2.0:1788725960.828982:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511552 00000100:00100000:2.0:1788725960.828993:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512064 00000100:00100000:2.0:1788725960.828995:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512064 00000100:00100000:2.0:1788725960.829005:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512576 00000100:00100000:2.0:1788725960.829017:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512576 00000100:00100000:2.0:1788725960.829032:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788725960.829038:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.829076:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791512192:12345-0@lo:400:kworker.0 Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.829081:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788725960.829093:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788725960.829099:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791511552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.829147:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791511552:12345-0@lo:400:kworker.0 Request processed in 48us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.829153:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788725960.829163:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788725960.829168:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791512064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.829193:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791512064:12345-0@lo:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.829198:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788725960.829209:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788725960.829214:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.829238:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875614791512576:12345-0@lo:400:kworker.0 Request processed in 24us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725960.829243:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788725960.829266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791511552:0@lo:400:kworker.0 00000100:00100000:2.0:1788725960.829275:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791512064:0@lo:400:kworker.0 00010000:00080000:2.0:1788725960.829287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283264a80 x1875614791512576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725960.829309:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1875614791512576:0@lo:400:kworker.0 00010000:00080000:2.0:1788725960.829321:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283c9c380 x1875614791512192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725960.829329:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791512192:0@lo:400:kworker.0 00000100:00080000:2.0:1788725960.829391:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725960.829395:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788725960.829398:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725960.830252:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af8cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791511808:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830334:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791512320:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830393:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791512832:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830445:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788725960.830452:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791511424:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830499:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791511936:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830541:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791512448:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830578:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791512960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725960.830621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725960.830665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511936 00000100:00100000:0.0:1788725960.830671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511936 00000100:00100000:0.0:1788725960.830713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788725960.830722:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791511936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.830994:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791511936:12345-0@lo:400:kworker.0 Request processed in 273us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.831002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788725960.831035:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512960 00000100:00100000:0.0:1788725960.831039:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512960 00000100:00100000:0.0:1788725960.831064:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788725960.831069:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791512960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725960.831091:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788725960.831141:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791512960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.831146:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788725960.831206:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791511936:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.831223:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791512960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725960.831249:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511808 00000100:00100000:0.0:1788725960.831253:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511808 00000100:00100000:0.0:1788725960.831270:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512448 00000100:00100000:0.0:1788725960.831273:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512448 00000100:00100000:0.0:1788725960.831295:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788725960.831301:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791511808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.831334:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791511808:12345-0@lo:400:kworker.0 Request processed in 33us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.831339:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788725960.831362:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788725960.831368:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791512448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.831392:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791512448:12345-0@lo:400:kworker.0 Request processed in 24us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725960.831396:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:0.0:1788725960.831409:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725960.831704:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512320 00000100:00100000:3.0:1788725960.831709:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512320 00000100:00100000:3.0:1788725960.831917:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791512832 00000100:00100000:3.0:1788725960.831921:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791512832 00000100:00100000:3.0:1788725960.831948:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788725960.831955:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791512320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725960.831993:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791512320:12345-0@lo:400:kworker.0 Request processed in 39us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.831999:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788725960.832011:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788725960.832017:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725960.832041:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791512832:12345-0@lo:400:kworker.0 Request processed in 25us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.832046:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788725960.832067:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791511424 00000100:00100000:3.0:1788725960.832070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791511424 00000100:00100000:3.0:1788725960.832094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788725960.832100:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791511424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725960.832157:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3638:x1875614791511424:12345-0@lo:400:kworker.0 Request processed in 57us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.832164:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788725960.832226:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725960.832236:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725960.832261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725960.832286:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791513088 00000100:00100000:3.0:1788725960.832290:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791513088 00000100:00100000:3.0:1788725960.832319:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788725960.832326:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791513088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725960.832338:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788725960.832378:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e9a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791513088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725960.832384:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788725960.834018:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791513088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788725960.834045:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725960.834050:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725960.835088:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791512448:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.835162:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af8cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791511808:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.835176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791512320:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.835186:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791512832:0@lo:400:kworker.0 00000100:00100000:0.0:1788725960.835218:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791511424:0@lo:400:kworker.0 00000100:00100000:1.0:1788725960.936093:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725960.936217:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476032 00000100:00100000:0.0:1788725960.936225:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476032 00000100:00100000:0.0:1788725960.936284:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 167 00000100:00100000:0.0:1788725960.936294:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+41:12265:x1875614770476032:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788725960.936317:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725960.936335:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d3797d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ff5 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.936469:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37984 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.936483:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.936497:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725960.936507:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788725960.936637:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d3797d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ff5 expref: 44 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.936657:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ff5 expref: 43 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.936686:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725960.936689:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725960.936693:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788725960.936749:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+43:12265:x1875614770476032:12345-192.168.203.12@tcp:101:cat.0 Request processed in 456us (666us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788725960.936756:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 167 00000001:00080000:1.0:1788725960.947660:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1788725960.947697:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788725960.947725:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b1283474c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788725960.947729:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e615a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283474b40 00000020:00080000:1.0:1788725960.947733:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e615700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283cfd600 00000100:00100000:3.0:1788725960.948906:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788725960.948926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791513216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788725960.948990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725960.949065:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791513216 00000100:00100000:3.0:1788725960.949073:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791513216 00000100:00100000:3.0:1788725960.949138:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788725960.949148:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875614791513216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788725960.949174:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1788725960.949205:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9dcac7, atime: 0x6a9dcac7, ctime: 0x6a9dcac7, blocks: 0x8 00010000:00010000:3.0:1788725960.949213:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949229:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1788725960.949233:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725960.949239:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949255:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949279:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949287:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949303:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788725960.949638:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1875614791513216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 490us (646us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788725960.949647:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1788725960.949669:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725960.949676:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949684:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725960.949688:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949697:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949712:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949720:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2932449/0xa13c582691d37992 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725960.949746:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725960.949749:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725960.949750:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788725960.949784:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b13af867100/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788725960.949790:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af867100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791513216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788725960.949923:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725960.949995:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476288 00000100:00100000:3.0:1788725960.950000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476288 00000100:00100000:3.0:1788725960.950043:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788725960.950053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:12265:x1875614770476288:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:3.0:1788725960.950253:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+21:12265:x1875614770476288:12345-192.168.203.12@tcp:35:cat.0 Request processed in 202us (332us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788725960.950260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000020:00080000:2.0:1788725960.952717:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788725960.952791:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788725960.955447:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955465:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955474:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955481:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725960.955485:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955492:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955509:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b1283234900) 00010000:00010000:0.0:1788725960.955512:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725960.955516:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955522:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d3786c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955566:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955573:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955579:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955584:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725960.955588:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.955593:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956054:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725960.956058:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725960.956062:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956069:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37873 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956087:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956095:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956102:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956142:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725960.956147:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956154:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956163:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283234f00) 00010000:00010000:0.0:1788725960.956166:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725960.956169:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725960.956176:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d378b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725960.966841:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725960.967457:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476416 00000100:00100000:1.0:1788725960.967468:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476416 00000100:00100000:1.0:1788725960.967539:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788725960.967549:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+19:2397:x1875614770476416:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725960.967566:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725960.967602:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37984 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ff5 expref: 19 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725960.967634:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725960.967639:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725960.967700:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+18:2397:x1875614770476416:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 152us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725960.967708:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788725961.123842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725961.124010:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476672 00000100:00100000:0.0:1788725961.124018:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476672 00000100:00100000:0.0:1788725961.124074:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:0.0:1788725961.124082:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:12271:x1875614770476672:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:0.0:1788725961.124102:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725961.124111:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788725961.124170:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d378ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fcb expref: 18 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124184:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725961.124187:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725961.124197:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37999 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a6ffc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124298:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124308:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124314:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124335:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.124344:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 18 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725961.124375:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513344:192.168.203.12@tcp:104: 00000100:00080000:3.0:1788725961.124462:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725961.124463:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725961.128176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725961.128297:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476800 00000100:00100000:1.0:1788725961.128306:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476800 00010000:00010000:1.0:1788725961.128363:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 19 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725961.128406:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788725961.128416:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab291c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:2396:x1875614770476800:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725961.128429:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725961.128436:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 19 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.128448:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 19 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.128470:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725961.128475:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.128485:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.128492:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.128526:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725961.128706:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab291c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:2396:x1875614770476800:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 290us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725961.128714:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00010000:00010000:0.0:1788725961.128911:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fee expref: 18 pid: 6512 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725961.128928:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513344:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725961.128949:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.128959:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.128976:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725961.128993:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788725961.129241:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37999 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.129258:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.129266:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725961.129268:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788725961.129270:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8800, rc 0) 00000100:00100000:0.0:1788725961.129298:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:12271:x1875614770476672:12345-192.168.203.12@tcp:101:dd.0 Request processed in 5216us (5462us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788725961.129305:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 168 00000100:00100000:1.0:1788725961.136390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725961.136576:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770476928 00000100:00100000:2.0:1788725961.136587:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770476928 00000100:00100000:2.0:1788725961.136639:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1788725961.136649:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:12271:x1875614770476928:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788725961.136673:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725961.136693:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7003 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.136729:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.136744:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.136756:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.137774:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 20 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.137798:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.137807:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725961.137810:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788725961.137814:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6600, rc 0) 00000100:00100000:2.0:1788725961.137945:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:12271:x1875614770476928:12345-192.168.203.12@tcp:101:dd.0 Request processed in 1296us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725961.137954:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 169 00000100:00100000:2.0:1788725961.144726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725961.144856:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770477184 00000100:00100000:3.0:1788725961.144865:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770477184 00000100:00100000:3.0:1788725961.144989:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 170 00000100:00100000:3.0:1788725961.144999:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:12271:x1875614770477184:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788725961.145345:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.145371:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.145383:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788725961.145441:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788725961.145462:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e43e7322 reply state 00000000c6a48f3d transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.145475:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.145482:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725961.145485:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788725961.145488:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788725961.145580:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+22:12271:x1875614770477184:12345-192.168.203.12@tcp:36:dd.0 Request processed in 581us (861us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788725961.145587:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 170 00000020:00080000:3.0:1788725961.145592:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788725961.545436:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725961.545689:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770477312 00000100:00100000:0.0:1788725961.545698:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770477312 00000100:00100000:0.0:1788725961.545761:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 171 00000100:00100000:0.0:1788725961.545771:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+22:12285:x1875614770477312:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788725961.545795:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725961.545815:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d379c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a700a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545880:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545914:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545926:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545941:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545949:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.545967:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.546328:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.546342:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.546363:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.546398:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725961.546412:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725961.546525:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513472:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725961.546695:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725961.562853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725961.562971:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513472:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725961.563016:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725961.563159:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770477568 00000100:00100000:3.0:1788725961.563167:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770477568 00000100:00100000:3.0:1788725961.563218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788725961.563228:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:6636:x1875614770477568:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788725961.563542:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+25:6636:x1875614770477568:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 315us (698us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788725961.563550:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788725961.568618:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725961.568773:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770477696 00000100:00100000:1.0:1788725961.568787:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770477696 00010000:00010000:1.0:1788725961.570671:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725961.570858:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:1.0:1788725961.570891:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+25:2396:x1875614770477696:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725961.570917:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725961.570928:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.570944:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.570973:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d379a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6ffc expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.570993:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725961.570999:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.571028:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.571037:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.571081:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725961.571217:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:2396:x1875614770477696:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 347us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725961.571225:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00010000:00010000:3.0:1788725961.571300:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571309:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725961.571388:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788725961.571402:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725961.571447:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571463:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571474:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571482:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571489:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571508:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725961.571513:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571523:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571534:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725961.571537:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725961.571542:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571548:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d379ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571561:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571578:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571585:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571590:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725961.571593:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571599:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571608:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1394485f00) 00010000:00010000:3.0:1788725961.571610:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725961.571612:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571618:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d379d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571665:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d379c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a700a expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571679:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a700a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.571687:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725961.571689:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725961.571698:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9c00, rc 0) 00000100:00100000:3.0:1788725961.571733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+23:12285:x1875614770477312:12345-192.168.203.12@tcp:101:stat.0 Request processed in 25964us (26317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725961.571741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 171 00010000:00010000:3.0:1788725961.596858:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725961.643673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725961.643837:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770477952 00000100:00100000:1.0:1788725961.643850:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770477952 00000100:00100000:1.0:1788725961.643936:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 172 00000100:00100000:1.0:1788725961.643948:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+23:12291:x1875614770477952:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:1.0:1788725961.644024:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725961.644058:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d379d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a700a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.644088:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725961.644094:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725961.644366:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.644384:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.644395:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725961.644467:0:11950:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788725961.644491:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3595399 reply state 00000000ccb1ef30 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.644818:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725961.644826:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725961.644829:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725961.644832:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788725961.645164:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+25:12291:x1875614770477952:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 1215us (1506us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788725961.645177:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 172 00000020:00080000:1.0:1788725961.645185:0:11950:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788725961.827796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725961.828047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770478080 00000100:00100000:2.0:1788725961.828061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770478080 00000100:00100000:2.0:1788725961.828234:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:2.0:1788725961.828248:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+25:12305:x1875614770478080:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:2.0:1788725961.828282:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725961.828308:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d379e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7011 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828407:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828424:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828456:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828474:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828481:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828488:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828816:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828827:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.828835:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725961.828900:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788725961.828906:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725961.828931:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829334:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829357:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829377:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829385:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829391:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725961.829397:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829406:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829421:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725961.829425:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725961.829431:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829437:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d379ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829454:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829460:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829467:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829472:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725961.829480:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829486:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829605:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283455600) 00010000:00010000:2.0:1788725961.829608:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725961.829612:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829618:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d379f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829662:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d379e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829678:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725961.829685:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725961.829688:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725961.829690:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7e00, rc 0) 00000100:00100000:2.0:1788725961.829873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+26:12305:x1875614770478080:12345-192.168.203.12@tcp:101:stat.0 Request processed in 1627us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725961.829893:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 173 00000100:00100000:1.0:1788725961.861426:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b138767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791513600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725961.861524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725961.862170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791513600 00000100:00100000:3.0:1788725961.862184:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791513600 00000100:00100000:3.0:1788725961.862265:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788725961.862277:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791513600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725961.862322:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725961.862414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791513600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725961.862422:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788725961.862589:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b138767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791513600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788725961.940781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725961.940845:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770478336 00000100:00100000:3.0:1788725961.940859:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770478336 00000100:00100000:3.0:1788725961.941102:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:3.0:1788725961.941161:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+26:12315:x1875614770478336:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725961.941192:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725961.941230:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7018 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725961.941375:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788725961.942691:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37a02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7018 expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.942714:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:3.0:1788725961.942741:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788725961.942749:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7018 expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725961.942771:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044e00, rc 0) 00000100:00100000:3.0:1788725961.942860:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+27:12315:x1875614770478336:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1745us (2102us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788725961.943470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 174 00000100:00100000:1.0:1788725961.947370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725961.947470:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770478592 00000100:00100000:3.0:1788725961.947483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770478592 00000100:00100000:3.0:1788725961.947720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788725961.947734:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:12315:x1875614770478592:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725961.948035:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+28:12315:x1875614770478592:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 304us (689us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788725961.948044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788725962.033432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.033731:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770478848 00000100:00100000:2.0:1788725962.033745:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770478848 00000100:00100000:2.0:1788725962.033827:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:2.0:1788725962.033859:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+28:12321:x1875614770478848:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725962.034074:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725962.034102:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37a10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a701f expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.034283:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.034302:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.034313:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.034366:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.034383:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 29 pid: 6511 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725962.034400:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e33480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791513728:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725962.034728:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283454180 going to sleep for 11 seconds 00000100:00100000:2.0:1788725962.054318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.054408:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e33480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791513728:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725962.054448:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725962.055371:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770478976 00000100:00100000:3.0:1788725962.055385:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770478976 00010000:00010000:3.0:1788725962.055594:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 30 pid: 6511 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725962.055650:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:3.0:1788725962.055662:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:2396:x1875614770478976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725962.056305:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725962.056318:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 30 pid: 6511 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056336:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 30 pid: 6511 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056400:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d379fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7011 expref: 30 pid: 6511 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056497:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725962.056503:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056514:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056750:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.056862:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725962.057088:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+29:2396:x1875614770478976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1425us (2783us total) trans 0 rc 0/0 00010000:00010000:1.0:1788725962.057094:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725962.057099:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00010000:00010000:1.0:1788725962.057103:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725962.057171:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788725962.057365:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37a10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 30 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.057385:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 29 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.057394:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725962.057397:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725962.057399:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6800, rc 0) 00000100:00100000:1.0:1788725962.057441:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+29:12321:x1875614770478848:12345-192.168.203.12@tcp:101:bash.0 Request processed in 23586us (24025us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788725962.057450:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 175 00000100:00100000:1.0:1788725962.073699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.073854:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770479232 00000100:00100000:2.0:1788725962.073867:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770479232 00000100:00100000:2.0:1788725962.073962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 176 00000100:00100000:2.0:1788725962.073983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+29:12321:x1875614770479232:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788725962.074332:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.074379:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.074392:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725962.074444:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788725962.074467:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b500a4e reply state 00000000e2085065 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.074482:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.074490:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725962.074493:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725962.074498:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725962.074623:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+32:12321:x1875614770479232:12345-192.168.203.12@tcp:36:bash.0 Request processed in 650us (938us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788725962.074630:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 176 00000020:00080000:2.0:1788725962.074636:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788725962.083088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725962.083184:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770479360 00000100:00100000:3.0:1788725962.083198:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770479360 00000100:00100000:3.0:1788725962.083274:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:3.0:1788725962.083286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+32:12321:x1875614770479360:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788725962.083319:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725962.083357:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37a2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7026 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.083982:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.084004:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 33 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.084014:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.084059:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 33 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.084096:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 33 pid: 11950 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725962.084112:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513856:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725962.084316:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283454d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725962.088062:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1875614791513856:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725962.088099:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725962.093183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725962.094083:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770479488 00000100:00100000:3.0:1788725962.094100:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770479488 00010000:00010000:3.0:1788725962.094231:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 34 pid: 11950 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725962.094276:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788725962.094288:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+34:2395:x1875614770479488:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725962.094306:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725962.094313:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 34 pid: 11950 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094329:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 34 pid: 11950 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094365:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37a17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a701f expref: 34 pid: 11950 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094384:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725962.094389:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094402:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094618:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.094659:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725962.094926:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+33:2395:x1875614770479488:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 585us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725962.094936:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00010000:00010000:2.0:1788725962.095611:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.095623:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725962.095699:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788725962.095705:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725962.095731:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.095773:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37a2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7026 expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.095796:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7026 expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.095804:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725962.095817:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725962.095821:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7200, rc 0) 00000100:00100000:2.0:1788725962.095884:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+32:12321:x1875614770479360:12345-192.168.203.12@tcp:101:bash.0 Request processed in 12600us (12810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725962.095893:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 177 00000100:00100000:0.0:1788725962.116934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.117695:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770479744 00000100:00100000:1.0:1788725962.117710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770479744 00000100:00100000:1.0:1788725962.117797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:1.0:1788725962.117811:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+32:12321:x1875614770479744:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:1.0:1788725962.118166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+33:12321:x1875614770479744:12345-192.168.203.12@tcp:35:bash.0 Request processed in 358us (1254us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788725962.118175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:3.0:1788725962.275259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.275459:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480000 00000100:00100000:1.0:1788725962.275471:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480000 00000100:00100000:1.0:1788725962.275552:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:1.0:1788725962.275564:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+33:12331:x1875614770480000:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725962.275638:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725962.275667:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a702d expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725962.275799:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788725962.276317:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37a3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a702d expref: 35 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.276335:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:1.0:1788725962.276338:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725962.276352:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a702d expref: 35 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.276368:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e600, rc 0) 00000100:00100000:1.0:1788725962.276456:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+34:12331:x1875614770480000:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 894us (1211us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788725962.276465:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 178 00000100:00100000:2.0:1788725962.288685:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725962.288849:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480128 00000100:00100000:0.0:1788725962.288863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480128 00000100:00100000:0.0:1788725962.288958:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:0.0:1788725962.288980:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+34:12331:x1875614770480128:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788725962.289083:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289107:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289179:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289198:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289206:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289233:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289325:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289336:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289351:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725962.289410:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289425:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289432:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289439:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289445:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725962.289451:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289459:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289473:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725962.289482:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725962.289488:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37a48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289517:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289523:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289530:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289535:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725962.289539:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289544:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289551:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1394485000) 00010000:00010000:0.0:1788725962.289554:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725962.289557:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289563:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37a4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.289586:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290057:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290063:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290069:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725962.290073:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290080:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290090:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725962.290092:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725962.290095:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.290102:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37a56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725962.290332:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+34:12331:x1875614770480128:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1358us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.290351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 179 00000100:00100000:0.0:1788725962.305305:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.305396:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480384 00000100:00100000:1.0:1788725962.305411:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480384 00000100:00100000:1.0:1788725962.305500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788725962.305514:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+34:12331:x1875614770480384:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788725962.305916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+35:12331:x1875614770480384:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 403us (624us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788725962.305925:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788725962.411330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.411501:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480640 00000100:00100000:2.0:1788725962.411515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480640 00000100:00100000:2.0:1788725962.411605:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788725962.411617:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+35:12334:x1875614770480640:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725962.411651:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725962.411680:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6c00/0xa13c582691d37a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7034 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411785:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411803:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411819:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411840:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411849:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.411856:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412031:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412041:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412049:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725962.412060:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788725962.412205:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412214:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412222:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412228:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725962.412235:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412244:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412259:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725962.412262:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725962.412268:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412285:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412301:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412306:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412312:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412317:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725962.412320:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412325:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412333:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283455600) 00010000:00010000:2.0:1788725962.412335:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725962.412348:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412355:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412413:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6c00/0xa13c582691d37a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7034 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412427:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7034 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.412442:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725962.412445:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725962.412448:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6200, rc 0) 00000100:00100000:2.0:1788725962.412539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:12334:x1875614770480640:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 923us (1225us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788725962.412548:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 180 00000100:00100000:2.0:1788725962.419107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.419202:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725962.419397:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480896 00000100:00100000:3.0:1788725962.419410:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480896 00000100:00100000:3.0:1788725962.419653:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788725962.419667:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+37:2397:x1875614770480896:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725962.419689:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725962.419724:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7034 expref: 37 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.419747:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725962.419752:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725962.419827:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+36:2397:x1875614770480896:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 163us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725962.419835:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788725962.420153:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770480768 00000100:00100000:1.0:1788725962.420179:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770480768 00000100:00100000:1.0:1788725962.420219:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:1.0:1788725962.420228:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+36:12334:x1875614770480768:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725962.420306:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420324:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420337:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420391:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420399:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420406:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420422:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725962.420428:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420436:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420447:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725962.420451:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725962.420455:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.420473:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37a80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725962.421205:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+36:12334:x1875614770480768:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 973us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725962.421214:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 181 00000100:00100000:0.0:1788725962.432928:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.439931:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770481152 00000100:00100000:1.0:1788725962.439954:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770481152 00000100:00100000:1.0:1788725962.440052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788725962.440066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+36:12334:x1875614770481152:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:1.0:1788725962.440627:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:12334:x1875614770481152:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 560us (7709us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788725962.440636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00010000:00010000:3.0:1788725962.630285:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725962.647268:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.647401:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770481408 00000100:00100000:2.0:1788725962.647417:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770481408 00000100:00100000:2.0:1788725962.647511:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:2.0:1788725962.647528:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+37:12352:x1875614770481408:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788725962.647565:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725962.647603:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a703b expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.647751:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.647769:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.647781:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725962.647795:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788725962.647931:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a703b expref: 40 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.647973:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a703b expref: 39 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.647984:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725962.647987:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788725962.647991:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6400, rc 0) 00000100:00100000:2.0:1788725962.648080:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+39:12352:x1875614770481408:12345-192.168.203.12@tcp:101:cat.0 Request processed in 559us (827us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788725962.648087:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 182 00000100:00100000:3.0:1788725962.697666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.697785:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770481536 00000100:00100000:2.0:1788725962.697799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770481536 00000100:00100000:2.0:1788725962.698248:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:2.0:1788725962.698263:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+39:12353:x1875614770481536:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725962.698298:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725962.698323:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7042 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698436:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698453:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698464:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725962.698532:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788725962.698554:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725962.698582:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698616:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7042 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698638:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7042 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725962.698649:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725962.698652:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788725962.698657:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7a00, rc 0) 00000100:00100000:2.0:1788725962.698745:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+40:12353:x1875614770481536:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 485us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725962.698751:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 183 00000100:00100000:0.0:1788725962.708365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725962.708505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770481920 00000100:00100000:3.0:1788725962.708518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770481920 00000100:00100000:3.0:1788725962.708606:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:3.0:1788725962.708618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+40:12353:x1875614770481920:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788725962.709033:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:12353:x1875614770481920:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 415us (693us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788725962.709043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788725962.712648:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.712753:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482048 00000100:00100000:1.0:1788725962.712767:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482048 00000100:00100000:1.0:1788725962.712853:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788725962.712874:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+41:12353:x1875614770482048:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:1.0:1788725962.712901:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788725962.712932:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d37a33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7026 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.712961:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37a8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a703b expref: 40 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.712975:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37929 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fe0 expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.713008:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725962.713014:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725962.713091:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+38:12353:x1875614770482048:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 228us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725962.713100:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:3.0:1788725962.718954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725962.719510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482176 00000100:00100000:0.0:1788725962.719598:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482176 00000100:00100000:0.0:1788725962.719744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:0.0:1788725962.719758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+38:12353:x1875614770482176:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:0.0:1788725962.719905:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.719926:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725962.719978:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788725962.720318:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788725962.721078:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+38:12353:x1875614770482176:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 1314us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.721091:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 184 00000100:00100000:0.0:1788725962.762987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725962.763171:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482304 00000100:00100000:2.0:1788725962.763184:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482304 00000100:00100000:3.0:1788725962.763914:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 185 00000100:00100000:3.0:1788725962.763931:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:12355:x1875614770482304:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725962.763980:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725962.764008:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7049 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764098:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764141:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764156:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764174:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764181:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764187:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764290:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764300:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764306:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725962.764376:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788725962.764387:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725962.764414:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764428:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764438:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764444:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764450:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764457:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725962.764462:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764470:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764485:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725962.764488:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725962.764507:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764515:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37ab8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764534:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764550:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764556:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764561:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2045a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725962.764564:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764570:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764579:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b13ab2f2400) 00010000:00010000:3.0:1788725962.764582:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725962.764585:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764590:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37abf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764631:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37ab1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764647:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725962.764654:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725962.764657:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788725962.764666:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380031a00, rc 0) 00000100:00100000:3.0:1788725962.764766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+39:12355:x1875614770482304:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 839us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725962.764773:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 185 00000040:00080000:1.0:1788725962.939919:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725962.939934:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725962.939967:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788725962.939975:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725962.940260:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283265880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791513984:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788725962.940831:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725962.955983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725962.956037:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482432 00000100:00100000:0.0:1788725962.956047:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482432 00000100:00100000:0.0:1788725962.956145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:0.0:1788725962.956159:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770482432:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788725962.956214:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788725962.956386:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770482432:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 230us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725962.956394:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 186 00000100:00100000:1.0:1788725962.957689:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283265880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791513984:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788725962.985623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725962.987074:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482560 00000100:00100000:1.0:1788725962.987097:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482560 00000100:00100000:1.0:1788725962.987206:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1788725962.987220:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+39:12366:x1875614770482560:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788725962.987314:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987349:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987366:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987384:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987403:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987411:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987447:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987459:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987466:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725962.987526:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788725962.987531:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725962.987547:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987559:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987566:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987574:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987581:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725962.987585:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987600:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987615:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:1.0:1788725962.987619:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725962.987624:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987630:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37acd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987647:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987654:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987660:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987666:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fe00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725962.987669:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987674:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987681:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9b1283235900) 00010000:00010000:1.0:1788725962.987684:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725962.987687:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987721:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37ad4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987739:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987746:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987752:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987757:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725962.987761:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987766:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987775:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725962.987777:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725962.987780:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725962.987785:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37adb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725962.988325:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+39:12366:x1875614770482560:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1101us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725962.988346:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 187 00000100:00100000:1.0:1788725963.000833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.001043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482816 00000100:00100000:0.0:1788725963.001077:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482816 00000100:00100000:0.0:1788725963.001203:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00100000:0.0:1788725963.001217:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+39:12366:x1875614770482816:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725963.001247:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725963.001273:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37ae2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7050 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001434:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001452:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001466:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725963.001480:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788725963.001575:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001583:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001590:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001601:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725963.001606:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001613:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001637:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725963.001640:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725963.001646:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001653:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37ae9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001702:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37ae2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7050 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001713:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725963.001715:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725963.001719:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37ae2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7050 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.001729:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9200, rc 0) 00000100:00100000:0.0:1788725963.001807:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770482816:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 593us (990us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788725963.001815:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 188 00000100:00080000:1.0:1788725963.003096:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725963.011450:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.011676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770482944 00000100:00100000:2.0:1788725963.011688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770482944 00000100:00100000:2.0:1788725963.011782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:2.0:1788725963.011794:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770482944:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788725963.012535:0:6512:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788725963.012752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770482944:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 955us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.012761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 189 00000100:00100000:0.0:1788725963.022659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.023050:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770483200 00000100:00100000:2.0:1788725963.023063:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770483200 00000100:00100000:2.0:1788725963.023423:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:2.0:1788725963.023437:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770483200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725963.023466:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725963.023470:0:11950:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788725963.023519:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7042 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.023541:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725963.023547:0:11950:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725963.023665:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37af7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7057 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788725963.025528:0:11950:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788725963.025775:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.025806:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.025820:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.025908:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37af7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7057 expref: 42 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.025932:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7057 expref: 41 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.026815:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485000) 00010000:00010000:0.0:1788725963.026822:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725963.026827:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9c00, rc 0) 00000100:00100000:0.0:1788725963.026939:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+41:12366:x1875614770483200:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3502us (4292us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788725963.027472:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 190 00000100:00100000:0.0:1788725963.036627:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.037648:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770483456 00000100:00100000:3.0:1788725963.037665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770483456 00000100:00100000:3.0:1788725963.037764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:3.0:1788725963.037779:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:12366:x1875614770483456:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.037879:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725963.037918:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9c00/0xa13c582691d37afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7057 expref: 41 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038095:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485000) 00010000:00010000:3.0:1788725963.038111:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725963.038186:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038204:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038217:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038232:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038239:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038246:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038316:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038324:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038332:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.038796:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1380030400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.038802:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039024:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039039:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725963.039043:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725963.039047:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039053:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039071:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039078:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039085:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039099:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1380031000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.039114:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039149:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039159:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xda93e75 (ffff9b13ab2f2400) 00010000:00010000:3.0:1788725963.039161:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725963.039163:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.039168:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xda93e75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.039303:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770483456:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1525us (2687us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788725963.039313:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 191 00000100:00100000:2.0:1788725963.046368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.046435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770483584 00000100:00100000:0.0:1788725963.046448:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770483584 00000100:00100000:0.0:1788725963.046526:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:0.0:1788725963.046539:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+40:12366:x1875614770483584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725963.046569:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725963.046601:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a705e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046669:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046684:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046696:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046835:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046856:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.046877:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:0.0:1788725963.046881:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788725963.046886:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9000, rc 0) 00000100:00100000:0.0:1788725963.047198:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+41:12366:x1875614770483584:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 660us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.047206:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 192 00000100:00100000:2.0:1788725963.064891:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.065063:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770483840 00000100:00100000:0.0:1788725963.065077:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770483840 00000100:00100000:0.0:1788725963.065175:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:0.0:1788725963.065187:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+41:12366:x1875614770483840:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788725963.065313:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.065356:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.065373:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788725963.065576:0:11950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788725963.065586:0:11950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408221468005ns, next at 409221464722ns, rc = 0 00000004:00010000:0.0:1788725963.065656:0:11950:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d5fe78e reply state 00000000cbf89b65 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.065671:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.065679:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:0.0:1788725963.065682:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788725963.065687:0:11950:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788725963.065812:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+43:12366:x1875614770483840:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 626us (945us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788725963.065820:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 193 00000100:00100000:1.0:1788725963.075149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.075694:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770483968 00000100:00100000:0.0:1788725963.075708:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770483968 00000100:00100000:0.0:1788725963.075788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1788725963.075802:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+43:12366:x1875614770483968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725963.075834:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725963.075861:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7065 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.075970:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.075986:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.076009:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:0.0:1788725963.076012:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725963.076017:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9e00, rc 0) 00000100:00100000:0.0:1788725963.076419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+44:12366:x1875614770483968:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 618us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.076427:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 194 00000100:00100000:0.0:1788725963.082610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.092156:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770484096 00000100:00100000:3.0:1788725963.092177:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770484096 00000100:00100000:3.0:1788725963.092291:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788725963.092305:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+6:2395:x1875614770484096:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788725963.092528:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725963.092917:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770484096:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 612us (10316us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788725963.093602:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788725963.098363:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.098513:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770484352 00000100:00100000:3.0:1788725963.098526:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770484352 00000100:00100000:3.0:1788725963.098621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1788725963.098634:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+44:12366:x1875614770484352:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725963.098957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+45:12366:x1875614770484352:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 325us (623us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788725963.098966:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1788725963.113314:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.113444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770484608 00000100:00100000:2.0:1788725963.113456:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770484608 00000100:00100000:2.0:1788725963.113533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:2.0:1788725963.113545:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+45:12366:x1875614770484608:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788725963.113716:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+45:12366:x1875614770484608:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 171us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.113725:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 195 00000100:00100000:0.0:1788725963.126764:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.126901:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770484736 00000100:00100000:3.0:1788725963.126914:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770484736 00000100:00100000:3.0:1788725963.126983:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:3.0:1788725963.126996:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+45:12366:x1875614770484736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.127025:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725963.127053:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a706c expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127184:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127203:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127217:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725963.127280:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725963.127305:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127352:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37b36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a706c expref: 47 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127387:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a706c expref: 46 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.127397:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:3.0:1788725963.127401:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788725963.127405:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380030400, rc 0) 00000100:00100000:3.0:1788725963.127470:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+46:12366:x1875614770484736:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 477us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725963.127478:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 196 00000100:00100000:1.0:1788725963.131575:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.139637:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770484864 00000100:00100000:3.0:1788725963.139657:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770484864 00000100:00100000:3.0:1788725963.140553:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788725963.140570:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770484864:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.140596:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725963.140622:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7073 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788725963.140653:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcaca, blocks: 0x0 00010000:00010000:3.0:1788725963.140680:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788725963.140686:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725963.141272:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.141302:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.141486:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045800, rc 0) 00000100:00100000:3.0:1788725963.141571:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770484864:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1006us (10010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725963.141580:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788725963.153275:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.153386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485120 00000100:00100000:0.0:1788725963.153399:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485120 00000100:00100000:0.0:1788725963.153473:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:0.0:1788725963.153485:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+46:12366:x1875614770485120:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788725963.153621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+46:12366:x1875614770485120:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 138us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.153628:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 197 00000100:00100000:0.0:1788725963.156669:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.156848:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485248 00000100:00100000:3.0:1788725963.156861:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485248 00000100:00100000:3.0:1788725963.156928:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788725963.156939:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:12366:x1875614770485248:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.156961:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725963.156982:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a707a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.157019:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.157028:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725963.157034:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725963.157039:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.157080:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.157138:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.157157:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791514112:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725963.157268:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788725963.168158:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791514112:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725963.168213:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.168265:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:0.0:1788725963.168373:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+9:12366:x1875614770485248:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 11433us (11716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.168383:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788725963.169562:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725963.170316:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485376 00000100:00100000:0.0:1788725963.170330:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485376 00010000:00010000:0.0:1788725963.170401:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725963.170450:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:0.0:1788725963.170463:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770485376:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725963.170480:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725963.170519:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.170535:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.170563:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6edf933/0xa13c582691d37b44 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7073 expref: 9 pid: 8427 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.170582:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725963.170586:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725963.170596:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.170625:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.171479:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725963.171511:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791514240:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788725963.171617:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725963.181212:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791514240:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788725963.181250:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725963.181324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770485376:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 10863us (11769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.181351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1788725963.186376:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.186432:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485504 00000100:00100000:3.0:1788725963.186445:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485504 00002000:00100000:3.0:1788725963.186518:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b12833db800 x1875614770485504/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:359/0 lens 504/0 e 0 to 0 dl 1788725974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725963.186530:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b12833db800 with x1875614770485504 ext(0->8) 00002000:00010000:3.0:1788725963.186536:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b12833db800 00000100:00100000:3.0:1788725963.186573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788725963.186585:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2397:x1875614770485504:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788725963.191234:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+10:2397:x1875614770485504:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 4632us (4856us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788725963.191255:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00002000:00100000:3.0:1788725963.191272:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9b12833db800 x1875614770485504/t4294967315(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:359/0 lens 504/448 e 0 to 0 dl 1788725974 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725963.191285:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b12833db800 with x1875614770485504 ext(0->8) 00002000:00010000:3.0:1788725963.191292:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b12833db800 00000100:00100000:2.0:1788725963.210845:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.210890:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485632 00000100:00100000:3.0:1788725963.210903:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485632 00000100:00100000:3.0:1788725963.210978:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:3.0:1788725963.210991:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+46:12366:x1875614770485632:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788725963.214461:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788725963.214475:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788725963.214520:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788725963.214540:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788725963.214550:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788725963.214599:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214611:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214619:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214624:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.214628:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214636:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214653:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725963.214655:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725963.214660:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214666:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d379bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214683:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214689:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214708:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214714:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.214717:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214722:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214730:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725963.214732:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725963.214735:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214740:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d379df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214750:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214756:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214762:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214766:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.214768:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214782:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214790:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725963.214792:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788725963.214795:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214801:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37a25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214811:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214816:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214822:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214826:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725963.214828:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214833:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214839:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:3.0:1788725963.214841:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788725963.214844:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.214858:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37b28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.215017:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:12366:x1875614770485632:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 4025us (4183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725963.215027:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 198 00000100:00100000:2.0:1788725963.215912:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791514368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788725963.215969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725963.217844:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791514368 00000100:00100000:0.0:1788725963.217866:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791514368 00000100:00080000:3.0:1788725963.217939:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725963.218097:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788725963.218112:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791514368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788725963.218321:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788725963.218325:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788725962 00002000:00010000:0.0:1788725963.218328:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788725963.218330:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788725962 -> 1788725962 00002000:00010000:0.0:1788725963.218347:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788725963.218447:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791514368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 339us (2476us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788725963.218455:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788725963.219513:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.219565:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770485760 00000100:00100000:2.0:1788725963.219575:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770485760 00000100:00100000:2.0:1788725963.219625:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788725963.219635:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+10:2395:x1875614770485760:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788725963.220019:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b139e7f1180/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788725963.220033:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791514368:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1788725963.225051:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788725963.225065:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788725963.225298:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770485760:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 5649us (5777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.225316:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:3.0:1788725963.233599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.233700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486016 00000100:00100000:2.0:1788725963.233709:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486016 00000100:00100000:2.0:1788725963.233763:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:2.0:1788725963.233773:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+19:12366:x1875614770486016:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788725963.233821:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725963.233844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37b3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a706c expref: 19 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.233862:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:2.0:1788725963.233877:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725963.233905:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.233919:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.233928:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725963.234037:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000644ee1c5 reply state 00000000b13e7f3a transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.234048:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.234055:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:2.0:1788725963.234070:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725963.234073:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725963.234181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12823da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:12366:x1875614770486016:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 408us (590us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788725963.234188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 199 00000100:00100000:3.0:1788725963.239058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.239423:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486144 00000100:00100000:1.0:1788725963.239439:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486144 00000100:00100000:1.0:1788725963.239520:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1788725963.239535:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770486144:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788725963.239884:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788725963.239889:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788725962 -> 1788725961 00002000:00010000:1.0:1788725963.239892:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788725959 00002000:00010000:1.0:1788725963.239894:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788725962 -> 1788725961 00002000:00010000:1.0:1788725963.239897:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788725963.239992:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2397:x1875614770486144:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 459us (940us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788725963.241081:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:2.0:1788725963.252451:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.252558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486400 00000100:00100000:3.0:1788725963.252568:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486400 00000100:00100000:3.0:1788725963.252625:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:3.0:1788725963.252635:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+20:12366:x1875614770486400:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.252708:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.252725:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.252735:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.252768:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.252781:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 20 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.252809:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791514496:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725963.252961:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788725963.260534:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791514496:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725963.260565:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.262676:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.264486:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486528 00000100:00100000:1.0:1788725963.264542:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486528 00010000:00010000:1.0:1788725963.264601:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 21 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.264661:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788725963.264675:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab292850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+21:2396:x1875614770486528:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725963.264693:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725963.264868:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 21 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.264885:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 21 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.264915:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37b21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a705e expref: 21 pid: 6512 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.264938:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:1.0:1788725963.264945:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.264957:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.264966:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.265001:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725963.265034:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.265088:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab292850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+20:2396:x1875614770486528:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 415us (2418us total) trans 0 rc 0/0 00010000:00010000:3.0:1788725963.265100:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265162:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265170:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265178:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00000100:00100000:1.0:1788725963.265185:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00010000:00010000:3.0:1788725963.265195:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265205:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265226:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:3.0:1788725963.265245:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788725963.265252:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.265258:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.265350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+19:12366:x1875614770486400:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 12711us (12905us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788725963.265359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 200 00000100:00100000:1.0:1788725963.269565:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.270304:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486656 00000100:00100000:3.0:1788725963.270320:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486656 00000100:00100000:3.0:1788725963.270397:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:3.0:1788725963.270408:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770486656:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.270452:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.270473:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.270482:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725963.270486:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725963.270490:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.270527:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.270558:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 8 pid: 8426 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.270573:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791514624:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725963.270660:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788725963.277405:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791514624:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725963.277437:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.280772:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.281055:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770486784 00000100:00100000:3.0:1788725963.281063:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770486784 00010000:00010000:3.0:1788725963.281100:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.281174:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:3.0:1788725963.281186:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770486784:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725963.281201:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725963.281226:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281240:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281262:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047fd15ca/0xa13c582691d37b4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a707a expref: 9 pid: 8426 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281288:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725963.281292:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788725963.281298:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281308:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.281654:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725963.281708:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770486784:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 524us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.281716:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00010000:00010000:3.0:1788725963.281878:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281889:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281908:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281917:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281925:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281933:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725963.281937:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281953:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281965:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.281973:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2932449/0xa13c582691d37b60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.282028:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770486656:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 11622us (12478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725963.282037:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:1.0:1788725963.285431:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.285504:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487040 00000100:00100000:3.0:1788725963.285512:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487040 00000100:00100000:3.0:1788725963.285563:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 201 00000100:00100000:3.0:1788725963.285571:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+19:12366:x1875614770487040:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788725963.285645:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.285661:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.285670:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.285700:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 19 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.285727:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 19 pid: 11950 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725963.285741:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791514752:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725963.285810:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788725963.288484:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.288588:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791514752:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725963.288614:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725963.289257:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487168 00000100:00100000:0.0:1788725963.289293:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487168 00010000:00010000:0.0:1788725963.289366:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 20 pid: 11950 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725963.289419:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 89 00000100:00100000:0.0:1788725963.289431:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:2395:x1875614770487168:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725963.289449:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725963.289457:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 20 pid: 11950 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289474:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 20 pid: 11950 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289502:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d379b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7003 expref: 20 pid: 11950 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289520:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725963.289527:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289658:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289667:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.289769:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725963.289850:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:2395:x1875614770487168:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 419us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.289870:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 89 00010000:00010000:3.0:1788725963.290163:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.290178:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.291285:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.291301:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.291307:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.291349:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.291368:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 19 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.291383:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791514880:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725963.291481:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283454a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788725963.297703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.298519:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487296 00000100:00100000:0.0:1788725963.298527:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791514880:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725963.298531:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487296 00010000:00010000:1.0:1788725963.298580:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 20 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.298580:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.298642:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:1.0:1788725963.298654:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:2395:x1875614770487296:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725963.298668:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725963.298676:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 20 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298690:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 20 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298713:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37b2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7065 expref: 20 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298730:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:1.0:1788725963.298736:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298746:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298772:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.298802:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725963.298859:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+19:2395:x1875614770487296:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 207us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.298985:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00010000:00010000:0.0:1788725963.299376:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.299388:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788725963.299551:0:11950:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788725963.300487:0:11950:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788725963.300571:0:11950:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788725963.300657:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11950:1875614791515008:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788725963.300714:0:11950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725963.300746:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788725963.300857:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791515008 00000100:00100000:0.0:1788725963.300871:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791515008 00000100:00100000:0.0:1788725963.300944:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788725963.300957:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11950:x1875614791515008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788725963.301092:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11950:x1875614791515008:12345-0@lo:1000:mdt00_004.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725963.301100:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788725963.301419:0:11950:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788725963.301426:0:11950:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b139e7f1180, transno 4294967316 00000100:00100000:1.0:1788725963.301452:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11950:1875614791515008:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788725963.301571:0:11950:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788725963.301628:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11950:1875614791515136:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788725963.301665:0:11950:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725963.301696:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788725963.302100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791515136 00000100:00100000:2.0:1788725963.302107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791515136 00000100:00100000:2.0:1788725963.302180:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788725963.302198:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11950:x1875614791515136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788725963.302312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11950:x1875614791515136:12345-0@lo:1000:mdt00_004.0 Request processed in 115us (645us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788725963.302319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788725963.303589:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11950:1875614791515136:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788725963.303886:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303900:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303910:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303928:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725963.303935:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303943:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303964:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:1.0:1788725963.303968:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725963.303974:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.303981:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b6e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304014:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304022:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304029:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304035:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725963.304039:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304045:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304066:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725963.304069:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725963.304072:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304079:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37aaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304109:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304163:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304175:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304225:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725963.304244:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 22 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.304261:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791515264:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725963.304814:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725963.311766:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791515264:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725963.311804:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725963.312514:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.314468:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487424 00000100:00100000:2.0:1788725963.314481:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487424 00010000:00010000:2.0:1788725963.318826:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 23 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.318878:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:2.0:1788725963.318888:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+23:2396:x1875614770487424:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725963.318903:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725963.318911:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 23 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.318925:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 23 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.318947:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37ac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7049 expref: 23 pid: 6510 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.318965:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725963.319300:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.319331:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.319351:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.319375:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725963.319434:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.319442:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:2396:x1875614770487424:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 556us (6933us total) trans 0 rc 0/0 00010000:00010000:0.0:1788725963.319443:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.319449:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00010000:00010000:0.0:1788725963.319555:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319564:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319577:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319584:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725963.319588:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319595:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319604:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725963.319607:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725963.319610:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319616:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37b75 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319627:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319633:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319638:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319643:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725963.319646:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319661:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319669:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725963.319672:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788725963.319674:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725963.319680:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37b67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725963.319819:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+21:12366:x1875614770487040:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 34247us (34397us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788725963.319830:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 201 00000020:00080000:0.0:1788725963.319835:0:11950:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788725963.319969:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725963.319974:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725963.321490:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788725963.321503:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788725963.329475:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.329549:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487680 00000100:00100000:2.0:1788725963.329563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487680 00000100:00100000:2.0:1788725963.329622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788725963.329633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+21:12366:x1875614770487680:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788725963.329875:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788725963.329905:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788725963.329938:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.329953:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.329966:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.329988:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.329995:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.330002:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.330020:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788725963.330140:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+23:12366:x1875614770487680:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 483us (656us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788725963.330149:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000020:00080000:2.0:1788725963.330154:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788725963.330714:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725963.330722:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.330730:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725963.330734:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.330742:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.330756:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:3.0:1788725963.330764:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788725963.330769:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.330835:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b7c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.330846:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725963.330847:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725963.330849:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725963.389551:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791515392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725963.389620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725963.389741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791515392 00000100:00100000:2.0:1788725963.389750:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791515392 00000100:00100000:2.0:1788725963.389799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788725963.389809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791515392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725963.389840:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788725963.389895:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791515392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.389902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788725963.392511:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791515392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788725963.647153:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788725963.702923:0:14648:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725963.702933:0:14648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725963.702961:0:14648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788725963.702967:0:14648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725963.906576:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13832ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791515520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725963.906643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725963.906717:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791515520 00000100:00100000:1.0:1788725963.906724:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791515520 00000100:00100000:1.0:1788725963.906770:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788725963.906779:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791515520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788725963.906807:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788725963.906850:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791515520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.906867:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1788725963.906887:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725963.906918:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13832ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791515520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725963.913346:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725963.913376:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791515648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725963.913440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725963.914345:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791515648 00000100:00100000:3.0:1788725963.914355:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791515648 00000100:00100000:3.0:1788725963.914459:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788725963.914470:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791515648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725963.914494:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725963.914554:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1875614791515648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725963.914561:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788725963.914605:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791515648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788725963.918240:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725963.941744:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725963.946994:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770487936 00000100:00100000:3.0:1788725963.947009:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770487936 00000100:00100000:3.0:1788725963.947070:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788725963.947080:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+23:12376:x1875614770487936:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725963.947106:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725963.947343:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7081 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.947447:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37b8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.947461:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37b8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.947474:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37b8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725963.947485:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788725963.947583:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7081 expref: 26 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.947599:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37b8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7081 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725963.947608:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725963.947611:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788725963.947614:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2044a00, rc 0) 00000100:00100000:3.0:1788725963.947671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:12376:x1875614770487936:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 593us (5937us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788725963.947679:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 202 00000100:00100000:3.0:1788725963.955359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725963.957451:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488064 00000100:00100000:2.0:1788725963.957466:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488064 00000100:00100000:2.0:1788725963.957528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:2.0:1788725963.957538:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+25:12376:x1875614770488064:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:2.0:1788725963.957608:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957637:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957652:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957659:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957666:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957739:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957748:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957755:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725963.957828:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957841:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957848:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957856:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957862:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725963.957866:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957874:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957887:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725963.957898:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725963.957903:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957910:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6000/0xa13c582691d37b98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957922:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957929:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957941:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957947:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725963.957950:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957956:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957964:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b12819cb900) 00010000:00010000:2.0:1788725963.957967:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725963.957970:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957977:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6800/0xa13c582691d37b9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.957989:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958139:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958146:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958151:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725963.958154:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958171:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958179:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b12819cba00) 00010000:00010000:2.0:1788725963.958181:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725963.958184:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725963.958189:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7c00/0xa13c582691d37ba6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725963.958277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+25:12376:x1875614770488064:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 739us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.958285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 203 00000100:00100000:1.0:1788725963.977191:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977229:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977278:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977298:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977342:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725963.977380:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488320 00000100:00100000:1.0:1788725963.977389:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488320 00000100:00100000:1.0:1788725963.977439:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488832 00000100:00100000:1.0:1788725963.977443:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488832 00000100:00100000:1.0:1788725963.977460:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488704 00000100:00100000:1.0:1788725963.977462:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488704 00000100:00100000:1.0:1788725963.977489:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 318 00000100:00100000:1.0:1788725963.977498:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770488320:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725963.977565:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770488320:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.977573:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 318 00000100:00100000:1.0:1788725963.977589:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 319 00000100:00100000:1.0:1788725963.977595:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770488832:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725963.977619:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770488832:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.977624:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 319 00000100:00100000:1.0:1788725963.977634:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 320 00000100:00100000:1.0:1788725963.977641:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770488704:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725963.977660:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2395:x1875614770488704:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.977666:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 320 00000100:00100000:1.0:1788725963.977682:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488576 00000100:00100000:1.0:1788725963.977685:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488576 00000100:00100000:1.0:1788725963.977704:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488448 00000100:00100000:1.0:1788725963.977707:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488448 00000100:00100000:1.0:1788725963.977723:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788725963.977729:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770488576:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725963.977751:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770488576:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.977756:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788725963.977765:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:1.0:1788725963.977778:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770488448:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725963.977817:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2395:x1875614770488448:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 40us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725963.977823:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00080000:1.0:1788725963.977841:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788725963.977845:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725963.977847:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725963.978847:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770488192 00000100:00100000:2.0:1788725963.978855:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770488192 00000100:00100000:2.0:1788725963.979062:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 388 00000100:00100000:2.0:1788725963.979072:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770488192:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725963.979134:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770488192:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725963.979142:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 388 00000100:00100000:1.0:1788725964.037079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.037292:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489088 00000100:00100000:0.0:1788725964.037303:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489088 00000100:00100000:0.0:1788725964.037378:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:0.0:1788725964.037389:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+25:12380:x1875614770489088:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725964.037410:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725964.037429:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37bad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7088 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037499:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037513:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037536:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037553:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037561:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037569:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037690:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037699:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037707:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725964.037716:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788725964.037792:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037799:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037805:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037811:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725964.037822:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037830:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037843:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725964.037846:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725964.037851:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037933:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37bb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037950:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037956:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037962:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037968:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725964.037971:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037976:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.037984:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1394485f00) 00010000:00010000:0.0:1788725964.037986:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725964.037995:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.038002:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37bbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.038047:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37bad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 28 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.038061:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 27 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.038067:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:0.0:1788725964.038069:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725964.038071:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8000, rc 0) 00000100:00100000:0.0:1788725964.038264:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+27:12380:x1875614770489088:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 876us (1194us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788725964.038273:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 204 00000100:00100000:3.0:1788725964.041574:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.041945:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489216 00000100:00100000:1.0:1788725964.041956:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489216 00000100:00100000:1.0:1788725964.042018:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1788725964.042028:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+27:12380:x1875614770489216:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725964.042098:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042114:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042153:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042200:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042210:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042217:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042241:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.042246:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042254:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042266:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.042269:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725964.042273:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.042280:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725964.042521:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+27:12380:x1875614770489216:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 492us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725964.042530:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 205 00000100:00100000:1.0:1788725964.049997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.050068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489472 00000100:00100000:0.0:1788725964.050078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489472 00000100:00100000:0.0:1788725964.050163:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788725964.050173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:12380:x1875614770489472:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725964.050604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+28:12380:x1875614770489472:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 431us (614us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788725964.050613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:0.0:1788725964.121385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.122440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489728 00000100:00100000:1.0:1788725964.122452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489728 00000100:00100000:1.0:1788725964.122506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:1.0:1788725964.122517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+28:11912:x1875614770489728:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.122542:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.122562:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a708f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.122668:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.122684:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 29 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.122713:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.122748:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 29 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.122762:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 29 pid: 11950 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725964.122775:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791515776:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725964.122899:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725964.125704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725964.125927:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489856 00000100:00100000:2.0:1788725964.125937:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489856 00010000:00010000:2.0:1788725964.125977:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 30 pid: 11950 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725964.126030:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788725964.126040:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+30:2396:x1875614770489856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725964.126056:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725964.126063:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 30 pid: 11950 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.126075:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 30 pid: 11950 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.126095:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:2.0:1788725964.126100:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.126109:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.126151:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.126171:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725964.126608:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+30:2396:x1875614770489856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 567us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725964.126617:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00010000:00010000:1.0:1788725964.126868:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37bc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7088 expref: 29 pid: 11950 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725964.126887:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791515776:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725964.126907:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.126917:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.126923:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725964.126941:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788725964.127077:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bd7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.127162:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.127171:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.127174:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725964.127177:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788725964.127206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+29:11912:x1875614770489728:12345-192.168.203.12@tcp:101:bash.0 Request processed in 4691us (5830us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788725964.127213:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 206 00000100:00100000:3.0:1788725964.133747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.135663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770489984 00000100:00100000:1.0:1788725964.135679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770489984 00000100:00100000:1.0:1788725964.135759:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:1.0:1788725964.135771:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+29:11912:x1875614770489984:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.135799:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.135820:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7096 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.135858:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37bf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.135872:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.135884:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.136017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37bec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7096 expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.136043:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7096 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.136052:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.136055:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788725964.136059:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:1.0:1788725964.136188:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:11912:x1875614770489984:12345-192.168.203.12@tcp:101:bash.0 Request processed in 419us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.136197:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 207 00000100:00100000:2.0:1788725964.143264:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.143358:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770490240 00000100:00100000:1.0:1788725964.143369:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770490240 00000100:00100000:1.0:1788725964.143430:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 208 00000100:00100000:1.0:1788725964.143441:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+30:11912:x1875614770490240:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:1.0:1788725964.143667:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.143682:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.143693:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788725964.143733:0:9522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788725964.143758:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd4182f9 reply state 0000000061f53a8c transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.143770:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.143796:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.143799:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725964.143802:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788725964.143841:0:9522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788725964.143940:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+34:11912:x1875614770490240:12345-192.168.203.12@tcp:36:bash.0 Request processed in 500us (685us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788725964.143947:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 208 00000020:00080000:1.0:1788725964.143952:0:9522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788725964.151107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.152390:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770490368 00000100:00100000:1.0:1788725964.152401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770490368 00000100:00100000:1.0:1788725964.152463:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:1.0:1788725964.152474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+34:11912:x1875614770490368:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.152499:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.152520:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37c01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a709d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.152579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37c01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a709d expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.152593:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37c01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a709d expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.152613:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.152616:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788725964.152620:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725964.152684:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+35:11912:x1875614770490368:12345-192.168.203.12@tcp:101:bash.0 Request processed in 212us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.152702:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 209 00000100:00100000:3.0:1788725964.178680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.179029:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770490496 00000100:00100000:1.0:1788725964.179038:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770490496 00000100:00100000:1.0:1788725964.179098:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:1.0:1788725964.179109:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:11912:x1875614770490496:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.179150:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.179171:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70a4 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725964.179194:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9dcac9, atime: 0x6a9dcac7, ctime: 0x6a9dcac9, blocks: 0x8 00010000:00010000:1.0:1788725964.179213:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1788725964.179218:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725964.179226:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.179244:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.179257:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fe00, rc 0) 00000100:00100000:1.0:1788725964.179315:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:11912:x1875614770490496:12345-192.168.203.12@tcp:101:bash.0 Request processed in 208us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.179322:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788725964.195777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725964.196167:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770490624 00000100:00100000:3.0:1788725964.196177:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770490624 00002000:00010000:3.0:1788725964.196233:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788725964.196237:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283e30e00 with x1875614770490624 ext(0->18446744073709551615) 00002000:00010000:3.0:1788725964.196250:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283e30e00. 00000100:00100000:3.0:1788725964.196288:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788725964.196299:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770490624:12345-192.168.203.12@tcp:10:bash.0 00002000:00010000:3.0:1788725964.196744:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788725964.196749:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788725961 -> 1788725963 00002000:00010000:3.0:1788725964.196752:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788725959 -> 1788725959 00002000:00010000:3.0:1788725964.196754:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788725961 -> 1788725963 00002000:00010000:3.0:1788725964.196756:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788725964.197076:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770490624:12345-192.168.203.12@tcp:10:bash.0 Request processed in 776us (1304us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788725964.197085:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00002000:00010000:3.0:1788725964.197089:0:8430:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788725964.197092:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283e30e00 with x1875614770490624 ext(0->18446744073709551615) 00002000:00010000:3.0:1788725964.197097:0:8430:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283e30e00. 00000100:00100000:3.0:1788725964.276386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.276592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770490752 00000100:00100000:0.0:1788725964.276601:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770490752 00000100:00100000:0.0:1788725964.276674:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:0.0:1788725964.276684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+35:12394:x1875614770490752:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:0.0:1788725964.276748:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276763:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276774:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276788:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276796:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276802:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276977:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276987:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.276994:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788725964.277038:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277049:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277061:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277069:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277075:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8c00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725964.277080:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277087:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277099:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725964.277102:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725964.277107:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277113:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8c00/0xa13c582691d37c0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277278:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277285:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277292:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277298:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725964.277307:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277314:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277323:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1394485f00) 00010000:00010000:0.0:1788725964.277334:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725964.277338:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277344:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8e00/0xa13c582691d37c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277361:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277368:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277375:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277380:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725964.277383:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277390:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277398:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:0.0:1788725964.277400:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725964.277408:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.277414:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9800/0xa13c582691d37c1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725964.278467:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+35:12394:x1875614770490752:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 1777us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725964.278488:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 210 00000100:00100000:2.0:1788725964.319688:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.319778:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770491008 00000100:00100000:1.0:1788725964.319787:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770491008 00000100:00100000:1.0:1788725964.319841:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:1.0:1788725964.319850:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+35:12397:x1875614770491008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725964.319900:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.319919:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37c24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70ab expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.319985:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320000:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320012:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320026:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320034:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320041:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320173:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320183:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320203:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725964.320213:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788725964.320288:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320297:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320305:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320312:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.320316:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320323:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320350:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725964.320353:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725964.320358:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320363:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320377:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320382:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320387:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320391:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.320401:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320407:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320415:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:1.0:1788725964.320417:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725964.320420:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320426:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320464:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37c24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ab expref: 38 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320478:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ab expref: 37 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.320486:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.320488:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788725964.320505:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a200, rc 0) 00000100:00100000:1.0:1788725964.320571:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+37:12397:x1875614770491008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 723us (894us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788725964.320578:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 211 00000100:00100000:0.0:1788725964.326865:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.327035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770491136 00000100:00100000:1.0:1788725964.327043:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770491136 00000100:00100000:1.0:1788725964.327103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:1.0:1788725964.327113:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+37:12397:x1875614770491136:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725964.327225:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.327244:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.327253:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.327285:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 37 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.327299:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 37 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725964.327313:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791515904:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725964.327409:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725964.339251:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.339418:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791515904:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725964.339443:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725964.339516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770491392 00000100:00100000:2.0:1788725964.339523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770491392 00000100:00100000:2.0:1788725964.339579:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788725964.339589:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:6166:x1875614770491392:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788725964.339850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+39:6166:x1875614770491392:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 261us (607us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788725964.340350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:2.0:1788725964.347934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.348212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770491520 00000100:00100000:0.0:1788725964.348222:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770491520 00010000:00010000:0.0:1788725964.348263:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 39 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725964.348304:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1788725964.348314:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+39:2396:x1875614770491520:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725964.348336:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725964.348344:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 39 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348357:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 39 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348379:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37bde lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a708f expref: 39 pid: 6512 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348394:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:0.0:1788725964.348399:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348408:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348428:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.348460:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725964.348515:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:2396:x1875614770491520:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 202us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725964.348522:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00010000:00010000:1.0:1788725964.348586:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348595:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348634:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348653:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348659:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348664:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.348669:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348675:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348685:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.348688:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725964.348691:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.348696:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725964.348736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+37:12397:x1875614770491136:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 21624us (21889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.348744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 212 00000100:00100000:3.0:1788725964.350986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.351550:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770491776 00000100:00100000:0.0:1788725964.351559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770491776 00000100:00100000:0.0:1788725964.351612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:0.0:1788725964.351622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+37:12397:x1875614770491776:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788725964.351830:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+38:12397:x1875614770491776:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 209us (852us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788725964.351838:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788725964.505227:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725964.505384:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770492032 00000100:00100000:2.0:1788725964.505393:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770492032 00000100:00100000:2.0:1788725964.505456:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:2.0:1788725964.505466:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+38:12408:x1875614770492032:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788725964.505490:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725964.505511:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d37c4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70b2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505583:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505597:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505609:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505622:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505643:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505650:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505748:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37c63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505758:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37c63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505765:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37c63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725964.505775:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788725964.505847:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505868:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505876:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505882:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725964.505887:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505894:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505916:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725964.505919:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725964.505923:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505930:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37c55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505943:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505949:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505956:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505962:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725964.505965:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505971:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505978:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b12819cba00) 00010000:00010000:2.0:1788725964.505980:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725964.505983:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.505988:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.506038:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6600/0xa13c582691d37c4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b2 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.506053:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37c63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b2 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.506060:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:2.0:1788725964.506062:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725964.506065:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6200, rc 0) 00000100:00100000:2.0:1788725964.506178:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+40:12408:x1875614770492032:12345-192.168.203.12@tcp:101:cat.0 Request processed in 712us (959us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788725964.506195:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 213 00000100:00100000:3.0:1788725964.517362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.517509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770492288 00000100:00100000:0.0:1788725964.517518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770492288 00000100:00100000:0.0:1788725964.517576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788725964.517587:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+40:12408:x1875614770492288:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788725964.517846:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:12408:x1875614770492288:12345-192.168.203.12@tcp:35:cat.0 Request processed in 260us (493us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788725964.517854:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:3.0:1788725964.568228:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.568379:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770492544 00000100:00100000:1.0:1788725964.568389:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770492544 00000100:00100000:1.0:1788725964.568451:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 214 00000100:00100000:1.0:1788725964.568461:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+41:12409:x1875614770492544:12345-192.168.203.12@tcp:36:rm.0 00010000:00010000:1.0:1788725964.568531:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788725964.568570:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37c01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a709d expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568592:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6200/0xa13c582691d37c63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b2 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568605:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ab expref: 39 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568618:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37bf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7096 expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568628:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.568633:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788725964.568654:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568667:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568677:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568691:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568699:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568706:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568789:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568798:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.568805:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788725964.569357:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788725964.569369:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409725251271ns, next at 410725248661ns, rc = 0 00010000:00010000:1.0:1788725964.569411:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569422:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569430:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569436:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569443:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569449:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569475:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788725964.569625:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569641:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569648:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569654:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.569658:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569666:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569677:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:1.0:1788725964.569680:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788725964.569685:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569691:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c7f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569707:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569713:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569719:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569724:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.569734:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569740:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569749:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725964.569751:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725964.569754:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569761:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725964.569771:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c950abc9 reply state 00000000d6496afc transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569781:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.569788:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:1.0:1788725964.569790:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725964.569793:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788725964.569873:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+39:12409:x1875614770492544:12345-192.168.203.12@tcp:36:rm.0 Request processed in 1411us (1652us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788725964.569881:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 214 00010000:00010000:3.0:1788725964.569948:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725964.569955:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725964.569966:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725964.569969:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725964.569975:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725964.569984:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:3.0:1788725964.569986:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788725964.569989:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725964.569994:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37c86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725964.570004:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725964.570005:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725964.570007:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725964.669274:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725964.676793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.678414:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770492800 00000100:00100000:1.0:1788725964.678428:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770492800 00000100:00100000:1.0:1788725964.678501:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:1.0:1788725964.678512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+39:12415:x1875614770492800:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.678536:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.678567:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c8d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678664:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678679:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678690:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678701:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678708:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.678714:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788725964.679037:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788725964.679206:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679214:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679221:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679250:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679266:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679272:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679278:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725964.679282:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679288:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679300:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725964.679303:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725964.679307:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679312:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37c94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725964.679337:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006946055 reply state 0000000072f5eaf3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679348:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679353:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:1.0:1788725964.679355:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788725964.679357:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788725964.679383:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37c8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679406:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 41 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.679413:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:1.0:1788725964.679415:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788725964.679418:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ba00, rc 0) 00000100:00100000:1.0:1788725964.679483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+42:12415:x1875614770492800:12345-192.168.203.12@tcp:101:bash.0 Request processed in 973us (2699us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788725964.679490:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 215 00000100:00100000:2.0:1788725964.689920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.691941:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770492928 00000100:00100000:1.0:1788725964.691955:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770492928 00000100:00100000:1.0:1788725964.692036:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788725964.692047:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770492928:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.692065:0:8716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.692087:0:8716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70c0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725964.692111:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788725964.692172:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1788725964.692177:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725964.692187:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 8 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.692206:0:8716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 8 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.692239:0:8716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ac00, rc 0) 00000100:00100000:1.0:1788725964.692298:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770492928:12345-192.168.203.12@tcp:101:bash.0 Request processed in 252us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.692305:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:3.0:1788725964.700710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.700894:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770493056 00000100:00100000:1.0:1788725964.700904:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770493056 00000100:00100000:1.0:1788725964.700969:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:1.0:1788725964.700980:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:12415:x1875614770493056:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788725964.700996:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.701015:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70c7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.701044:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 9 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.701054:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725964.701058:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725964.701063:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.701097:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 9 pid: 8716 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.701110:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 9 pid: 8716 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725964.701175:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1875614791516032:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725964.701306:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13855e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788725964.703995:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8425:1875614791516032:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725964.704027:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.704047:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b600, rc 0) 00000100:00100000:1.0:1788725964.704102:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+9:12415:x1875614770493056:12345-192.168.203.12@tcp:101:bash.0 Request processed in 3124us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.704112:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788725964.704752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.704826:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770493184 00000100:00100000:0.0:1788725964.704834:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770493184 00010000:00010000:0.0:1788725964.704882:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 10 pid: 8716 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725964.704944:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:0.0:1788725964.704954:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab290c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+10:2396:x1875614770493184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725964.704977:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725964.704996:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 10 pid: 8716 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.705008:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 10 pid: 8716 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.705028:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000221613e7/0xa13c582691d37cb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c0 expref: 10 pid: 8716 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.705043:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725964.705046:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788725964.705054:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.705063:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.705097:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725964.705110:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875614791516160:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788725964.705212:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788725964.710512:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.710615:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1875614791516160:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788725964.710640:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725964.710696:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab290c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770493184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 5742us (5945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725964.710707:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788725964.710815:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770493440 00000100:00100000:2.0:1788725964.710822:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770493440 00000100:00100000:2.0:1788725964.710882:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788725964.710892:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+42:12415:x1875614770493440:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788725964.711174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+43:12415:x1875614770493440:12345-192.168.203.12@tcp:35:bash.0 Request processed in 282us (671us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788725964.711181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788725964.966035:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.966194:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770493568 00000100:00100000:1.0:1788725964.966204:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770493568 00000100:00100000:1.0:1788725964.966265:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:1.0:1788725964.966275:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+43:12431:x1875614770493568:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725964.966299:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.966333:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70ce expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966395:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966409:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966423:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725964.966483:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788725964.966487:0:9522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725964.966503:0:9522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966526:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ce expref: 45 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966545:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ce expref: 44 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.966554:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725964.966557:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725964.966560:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:1.0:1788725964.966633:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+44:12431:x1875614770493568:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 358us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725964.966640:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 216 00000100:00100000:2.0:1788725964.972518:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725964.972636:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770493824 00000100:00100000:1.0:1788725964.972645:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770493824 00000100:00100000:1.0:1788725964.972705:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:1.0:1788725964.972716:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+44:12431:x1875614770493824:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725964.972736:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725964.972758:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ccc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70d5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.972857:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37cd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.972888:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.972899:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725964.972911:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788725964.973008:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ccc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70d5 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.973032:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70d5 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725964.973041:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:1.0:1788725964.973044:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788725964.973048:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788725964.973096:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+46:12431:x1875614770493824:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 382us (589us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788725964.973104:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 217 00000100:00100000:3.0:1788725964.982787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725964.982867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725964.983000:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494080 00000100:00100000:0.0:1788725964.983009:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494080 00000100:00100000:0.0:1788725964.983073:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788725964.983083:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+46:2398:x1875614770494080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725964.983097:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725964.983146:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37cd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70d5 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725964.983162:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:0.0:1788725964.983166:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725964.983227:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+45:2398:x1875614770494080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 146us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725964.983234:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788725964.988535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494208 00000100:00100000:2.0:1788725964.988552:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494208 00000100:00100000:2.0:1788725964.988613:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:2.0:1788725964.988623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+45:12431:x1875614770494208:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725964.988667:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725964.988687:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ce1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70dc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.988793:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.988808:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.988819:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725964.988831:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788725964.988938:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ce1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70dc expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.988956:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70dc expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725964.988965:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:2.0:1788725964.988967:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788725964.988970:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7800, rc 0) 00000100:00100000:2.0:1788725964.989039:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+47:12431:x1875614770494208:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 417us (6170us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788725964.989046:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 218 00000100:00100000:3.0:1788725965.011026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725965.015427:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494336 00000100:00100000:1.0:1788725965.015441:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494336 00000100:00100000:1.0:1788725965.015529:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:1.0:1788725965.015541:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770494336:12345-192.168.203.12@tcp:1:lfs.0 00010000:00010000:1.0:1788725965.015588:0:8716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.015608:0:8716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.015633:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788725965.015637:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788725965.015642:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.015681:0:8716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 8 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.015697:0:8716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 8 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725965.015712:0:8716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791516288:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725965.015821:0:8716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1381254b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788725965.016063:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725965.018944:0:8716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1281a29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8716:1875614791516288:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725965.018972:0:8716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725965.020023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725965.020374:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494464 00000100:00100000:1.0:1788725965.020383:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494464 00002000:00100000:1.0:1788725965.020431:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b13af8cf100 x1875614770494464/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:361/0 lens 504/0 e 0 to 0 dl 1788725976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788725965.020442:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af8cf100 with x1875614770494464 ext(0->8) 00010000:00010000:1.0:1788725965.020451:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.020485:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 9 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725965.020493:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b13af8cf100 00000100:00100000:1.0:1788725965.020527:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788725965.020537:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+9:2396:x1875614770494464:12345-192.168.203.12@tcp:4:lfs.0 00000100:00100000:1.0:1788725965.022038:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+11:2396:x1875614770494464:12345-192.168.203.12@tcp:4:lfs.0 Request processed in 1495us (2015us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788725965.022050:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00002000:00100000:1.0:1788725965.022061:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9b13af8cf100 x1875614770494464/t4294967309(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:361/0 lens 504/448 e 0 to 0 dl 1788725976 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788725965.022071:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b13af8cf100 with x1875614770494464 ext(0->8) 00010000:00010000:1.0:1788725965.022079:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.022096:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725965.022104:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b13af8cf100 00000100:00100000:0.0:1788725965.025622:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.025719:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494592 00000100:00100000:2.0:1788725965.025729:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494592 00010000:00010000:2.0:1788725965.025768:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725965.025824:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:2.0:1788725965.025835:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+11:2395:x1875614770494592:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725965.025866:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788725965.025885:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788725965.025888:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788725964 00002000:00010000:2.0:1788725965.025890:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788725964 00002000:00010000:2.0:1788725965.025893:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788725964 00002000:00010000:2.0:1788725965.025895:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788725965.025901:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.025915:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.025938:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d37cb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70c7 expref: 11 pid: 8425 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.025955:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725965.025960:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725965.025966:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.025976:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.026019:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725965.026069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+10:2395:x1875614770494592:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 235us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725965.026076:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00010000:00010000:1.0:1788725965.026616:0:8716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026628:0:8716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026663:0:8716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026672:0:8716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026680:0:8716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026687:0:8716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788725965.026690:0:8716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026698:0:8716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026711:0:8716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.026719:0:8716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f6bbf9/0xa13c582691d37cf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725965.026785:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af8cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770494336:12345-192.168.203.12@tcp:1:lfs.0 Request processed in 11246us (15768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.026793:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788725965.034776:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.034881:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494848 00000100:00100000:2.0:1788725965.034892:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494848 00000100:00100000:2.0:1788725965.034962:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:2.0:1788725965.034973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+47:12431:x1875614770494848:12345-192.168.203.12@tcp:35:lfs.0 00000004:00010000:2.0:1788725965.035038:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70dc expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725965.035241:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788725965.035271:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788725965.035543:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00080000:0.0:1788725965.035708:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788725965.035787:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.035804:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.035813:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.036003:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.036018:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 51 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725965.036043:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791516416:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725965.036837:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725965.045838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.046083:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770494976 00000100:00100000:3.0:1788725965.046093:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770494976 00010000:00010000:3.0:1788725965.046184:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 52 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725965.046217:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:3.0:1788725965.046226:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+52:2396:x1875614770494976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725965.046239:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725965.046246:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 52 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.046260:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 52 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.046282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:3.0:1788725965.046288:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.046299:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.046307:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.046337:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725965.046398:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+52:2396:x1875614770494976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 172us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.046406:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00010000:00010000:0.0:1788725965.046556:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37ca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70b9 expref: 51 pid: 6512 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725965.046597:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1875614791516416:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725965.046617:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.046627:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.046634:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788725965.046744:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788725965.046850:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788725965.046941:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791516544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788725965.046989:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725965.047069:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788725965.055332:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791516544 00000100:00100000:1.0:1788725965.055346:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791516544 00000100:00100000:1.0:1788725965.055414:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788725965.055425:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1875614791516544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788725965.055638:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1875614791516544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 214us (8647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.055646:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:0.0:1788725965.055745:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725965.064225:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791516544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788725965.064412:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788725965.064506:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791516672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788725965.064629:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.064668:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725965.064769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791516672 00000100:00100000:1.0:1788725965.064776:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791516672 00000100:00100000:1.0:1788725965.064833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788725965.064853:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1875614791516672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788725965.065663:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6513:x1875614791516672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 818us (1031us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788725965.065673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788725965.066147:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1875614791516672:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788725965.066209:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788725965.066249:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066260:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066269:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066277:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725965.066281:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066288:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066304:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:3.0:1788725965.066307:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788725965.066312:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.066318:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37cfd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788725965.066712:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788725965.066765:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788725965.066786:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410222668041ns, next at 411222666190ns, rc = 0 00000001:00080000:3.0:1788725965.066793:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788725965.066822:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1283235300) 00010000:00010000:3.0:1788725965.066825:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788725965.066832:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37ce8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70dc expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725965.067150:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+54:12431:x1875614770494848:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 32176us (32382us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788725965.067160:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00080000:3.0:1788725965.067165:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:3.0:1788725965.077919:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788725965.077932:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788725965.078180:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725965.078308:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770495104 00000100:00100000:0.0:1788725965.078318:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770495104 00000100:00100000:0.0:1788725965.078389:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:0.0:1788725965.078399:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+54:12431:x1875614770495104:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725965.078422:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725965.078443:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37d04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70e3 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.078503:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37d04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70e3 expref: 55 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.078536:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37d04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70e3 expref: 55 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.078555:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725965.078558:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725965.078561:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8a00, rc 0) 00000100:00100000:0.0:1788725965.078631:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+55:12431:x1875614770495104:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 232us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.078639:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 219 00000100:00100000:0.0:1788725965.087241:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.087954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770495360 00000100:00100000:2.0:1788725965.087964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770495360 00000100:00100000:2.0:1788725965.088023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788725965.088033:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+55:12431:x1875614770495360:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725965.088276:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13832bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+56:12431:x1875614770495360:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 243us (1043us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788725965.088284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788725965.217633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725965.217726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770495488 00000100:00100000:1.0:1788725965.217735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770495488 00000100:00100000:1.0:1788725965.217797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:1.0:1788725965.217807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+56:12441:x1875614770495488:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788725965.217900:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.217916:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.217928:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.217940:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.217970:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.217984:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218056:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218065:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218071:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788725965.218168:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218182:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218189:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218196:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218202:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725965.218205:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218212:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218232:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725965.218235:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725965.218240:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218246:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37d0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218260:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218266:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218272:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218278:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725965.218281:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218287:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218294:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:1.0:1788725965.218296:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725965.218299:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218304:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37d12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218338:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218345:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218352:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218358:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725965.218362:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218376:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218399:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:1.0:1788725965.218402:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725965.218405:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.218410:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725965.218697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+56:12441:x1875614770495488:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 887us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.218705:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 220 00000100:00100000:0.0:1788725965.270351:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725965.270426:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770495744 00000100:00100000:1.0:1788725965.270436:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770495744 00000100:00100000:1.0:1788725965.270499:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1788725965.270509:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+56:12444:x1875614770495744:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725965.270534:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725965.270554:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37d20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70ea expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270653:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270669:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270679:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270692:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270700:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270707:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270811:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270820:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270828:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725965.270838:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788725965.270923:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270930:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270943:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270949:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725965.270954:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270960:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270973:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:1.0:1788725965.270976:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725965.270981:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.270987:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d37d27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.271000:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.271006:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.271012:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.271018:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725965.271021:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.272494:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.272508:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:1.0:1788725965.272511:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725965.272515:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.272522:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ba00/0xa13c582691d37d2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.272741:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d37d20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ea expref: 59 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.272760:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ea expref: 58 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.272768:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725965.272781:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725965.272784:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:2.0:1788725965.272854:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+58:12444:x1875614770495744:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 2345us (2511us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788725965.272863:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 221 00000100:00100000:1.0:1788725965.284818:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.284974:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770495872 00000100:00100000:3.0:1788725965.284985:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770495872 00000100:00100000:3.0:1788725965.285044:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:3.0:1788725965.285054:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+58:12444:x1875614770495872:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788725965.285142:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285159:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285171:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285226:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285233:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285241:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285246:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788725965.285251:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285258:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285269:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725965.285272:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788725965.285277:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.285283:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725965.285359:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+58:12444:x1875614770495872:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 305us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.285366:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 222 00000100:00100000:0.0:1788725965.287971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.288050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770496128 00000100:00100000:2.0:1788725965.288058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770496128 00000100:00100000:2.0:1788725965.288140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:2.0:1788725965.288150:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+58:12444:x1875614770496128:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788725965.288353:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+59:12444:x1875614770496128:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 203us (387us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788725965.288360:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000040:00080000:3.0:1788725965.371854:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788725965.371918:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725965.371924:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725965.371942:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788725965.371948:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788725965.409353:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.409525:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770496384 00000100:00100000:2.0:1788725965.409536:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770496384 00000100:00100000:2.0:1788725965.409597:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:2.0:1788725965.409607:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+59:12454:x1875614770496384:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725965.409631:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725965.409634:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788725965.409660:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37cc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ce expref: 59 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.409679:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725965.409684:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725965.409697:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37d4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.409825:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37d51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.409839:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.409860:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725965.409886:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788725965.409981:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37d4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f1 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.409994:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f1 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.410002:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725965.410005:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725965.410008:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7a00, rc 0) 00000100:00100000:2.0:1788725965.410075:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+60:12454:x1875614770496384:12345-192.168.203.12@tcp:101:bash.0 Request processed in 468us (731us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788725965.410083:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 223 00000100:00100000:1.0:1788725965.414041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.414113:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770496512 00000100:00100000:1.0:1788725965.414159:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.414164:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770496512 00000100:00100000:2.0:1788725965.414229:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:2.0:1788725965.414240:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+60:12454:x1875614770496512:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788725965.414263:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725965.414281:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70f8 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414333:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414348:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414379:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414485:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 62 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414517:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 61 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.414526:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725965.414530:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788725965.414534:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7600, rc 0) 00000100:00100000:2.0:1788725965.414598:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+61:12454:x1875614770496512:12345-192.168.203.12@tcp:101:bash.0 Request processed in 360us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725965.414606:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 224 00000100:00100000:0.0:1788725965.414895:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770496640 00000100:00100000:0.0:1788725965.414901:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770496640 00000100:00100000:0.0:1788725965.414945:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788725965.414954:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+61:2396:x1875614770496640:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725965.414964:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725965.414979:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37d51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f1 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.414991:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725965.414994:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725965.415020:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1281a28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+60:2396:x1875614770496640:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 68us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.415037:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788725965.419702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725965.419777:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770496896 00000100:00100000:2.0:1788725965.419787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770496896 00000100:00100000:2.0:1788725965.419843:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 225 00000100:00100000:2.0:1788725965.419860:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+60:12454:x1875614770496896:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788725965.419916:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725965.419942:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37d35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ea expref: 60 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.419961:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725965.419965:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725965.420200:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.420228:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.420238:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725965.420284:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788725965.420328:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048edfd03 reply state 000000001d56568a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.420340:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725965.420347:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725965.420350:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725965.420352:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725965.420453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+62:12454:x1875614770496896:12345-192.168.203.12@tcp:36:bash.0 Request processed in 593us (759us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788725965.420459:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 225 00000020:00080000:2.0:1788725965.420465:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788725965.423758:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725965.423846:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497024 00000100:00100000:0.0:1788725965.423856:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497024 00000100:00100000:0.0:1788725965.423918:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:0.0:1788725965.423929:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+62:12454:x1875614770497024:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788725965.423952:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725965.423973:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37d74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a70ff expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424064:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424078:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424090:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725965.424167:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788725965.424172:0:11950:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725965.424201:0:11950:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424227:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37d74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 64 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424245:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 63 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.424273:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725965.424277:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725965.424281:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9000, rc 0) 00000100:00100000:0.0:1788725965.424347:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+63:12454:x1875614770497024:12345-192.168.203.12@tcp:101:bash.0 Request processed in 420us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.424354:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 226 00000100:00100000:1.0:1788725965.430767:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.431341:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497280 00000100:00100000:3.0:1788725965.431351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497280 00000100:00100000:3.0:1788725965.431418:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788725965.431429:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+63:12454:x1875614770497280:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788725965.431632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+64:12454:x1875614770497280:12345-192.168.203.12@tcp:35:bash.0 Request processed in 204us (873us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788725965.431640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788725965.502332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.502427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497408 00000100:00100000:3.0:1788725965.502436:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497408 00000100:00100000:3.0:1788725965.502507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:3.0:1788725965.502518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+64:12460:x1875614770497408:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725965.502542:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725965.502562:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7106 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502629:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502645:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502656:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725965.502699:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788725965.502703:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725965.502722:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502749:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7106 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502795:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7106 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.502803:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:3.0:1788725965.502806:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788725965.502809:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045800, rc 0) 00000100:00100000:3.0:1788725965.502877:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770497408:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 354us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.502884:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 227 00000100:00100000:1.0:1788725965.512799:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725965.513277:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497536 00000100:00100000:0.0:1788725965.513288:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497536 00000100:00100000:0.0:1788725965.514331:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:0.0:1788725965.514351:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770497536:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788725965.514374:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725965.514396:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37d90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a710d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514462:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514477:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514489:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514512:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514520:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514546:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514617:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514627:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514634:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725965.514675:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788725965.514680:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788725965.514699:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514711:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514720:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514727:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514735:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514740:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725965.514746:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514761:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514774:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725965.514777:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725965.514782:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514789:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37d97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514805:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514812:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514818:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514823:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725965.514826:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514832:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514839:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:0.0:1788725965.514841:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725965.514844:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37d9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514907:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37d90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a710d expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514919:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a710d expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.514927:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725965.514930:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725965.514932:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8800, rc 0) 00000100:00100000:0.0:1788725965.515009:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+66:12460:x1875614770497536:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 666us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.515017:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 228 00000100:00100000:2.0:1788725965.519717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.519805:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497920 00000100:00100000:3.0:1788725965.519815:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497920 00000100:00100000:3.0:1788725965.519891:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788725965.519901:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+66:2396:x1875614770497920:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725965.519916:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725965.519940:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8800/0xa13c582691d37da5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a710d expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.519959:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725965.519964:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725965.520031:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+65:2396:x1875614770497920:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.520038:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788725965.523076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725965.524333:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770497792 00000100:00100000:1.0:1788725965.524345:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770497792 00000100:00100000:1.0:1788725965.524406:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:1.0:1788725965.524416:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770497792:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:1.0:1788725965.524435:0:11950:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725965.524469:0:11950:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37dac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7114 expref: -99 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.525671:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.525693:0:11950:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 66 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.525702:0:11950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.525740:0:11950:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 66 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.525756:0:11950:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 66 pid: 11950 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725965.525772:0:11950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283695c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791516800:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788725965.526388:0:11950:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1381254b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725965.530977:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725965.531114:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498048 00000100:00100000:0.0:1788725965.531149:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498048 00010000:00010000:0.0:1788725965.531300:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 67 pid: 11950 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725965.531386:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:0.0:1788725965.531397:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+67:2395:x1875614770498048:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725965.531413:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725965.531420:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 67 pid: 11950 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.531453:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 67 pid: 11950 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.531476:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725965.531482:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.531504:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.531512:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725965.531531:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725965.531577:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+67:2395:x1875614770498048:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 182us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.531585:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00010000:00010000:1.0:1788725965.531859:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9000/0xa13c582691d37d7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70ff expref: 66 pid: 11950 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725965.531888:0:11950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283695c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11950:1875614791516800:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788725965.531909:0:11950:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.531919:0:11950:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.531936:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725965.531955:0:11950:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788725965.532086:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37dac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 67 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.532113:0:11950:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 66 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725965.532137:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:1.0:1788725965.532140:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788725965.532142:0:11950:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725965.532410:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+66:12460:x1875614770497792:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 7994us (9342us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788725965.532418:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 229 00000100:00100000:2.0:1788725965.538714:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.538797:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498304 00000100:00100000:3.0:1788725965.538807:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498304 00000100:00100000:3.0:1788725965.538884:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788725965.538906:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab293c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+66:12460:x1875614770498304:12345-192.168.203.12@tcp:103:lfs.0 00010000:00010000:3.0:1788725965.538925:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725965.538952:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8a00/0xa13c582691d37d04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70e3 expref: 66 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.538971:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725965.538977:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725965.539440:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab293c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770498304:12345-192.168.203.12@tcp:103:lfs.0 Request processed in 533us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.539448:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788725965.576469:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.576620:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498432 00000100:00100000:3.0:1788725965.576630:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498432 00000100:00100000:3.0:1788725965.576696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:3.0:1788725965.576708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770498432:12345-192.168.203.12@tcp:58:lfs.0 00010000:00010000:3.0:1788725965.576820:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.576840:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.576863:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788725965.576976:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788725965.577066:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770498432:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 359us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.577075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 230 00000100:00100000:2.0:1788725965.584851:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725965.585251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498560 00000100:00100000:3.0:1788725965.585273:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498560 00000100:00100000:3.0:1788725965.585343:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 231 00000100:00100000:3.0:1788725965.585354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+65:12460:x1875614770498560:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788725965.585374:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725965.585395:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a711b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585449:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585461:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585480:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585666:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585683:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725965.585686:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788725965.585691:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725965.585700:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2045a00, rc 0) 00000100:00100000:3.0:1788725965.585766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+66:12460:x1875614770498560:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 414us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.585775:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 231 00010000:00010000:2.0:1788725965.691359:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725965.947775:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725965.947797:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791516928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725965.947868:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948089:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791517184:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948200:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791517696:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948226:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948246:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791518208:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948291:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788725965.948307:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791517056:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948360:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791517568:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948401:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791518080:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725965.948450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517568 00000100:00100000:2.0:1788725965.948457:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517568 00000100:00100000:2.0:1788725965.948497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788725965.948506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791517568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948554:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791517568:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725965.948561:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788725965.948582:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791518080 00000100:00100000:2.0:1788725965.948585:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791518080 00000100:00100000:2.0:1788725965.948607:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788725965.948614:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948649:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791518080:12345-0@lo:400:kworker.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725965.948655:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788725965.948690:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791517568:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.948708:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788725965.948714:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:2.0:1788725965.948731:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b13af867100, transno 4294967308 00000004:00080000:2.0:1788725965.948741:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:2.0:1788725965.948755:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791518080:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949062:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791517440:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949131:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949193:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791518464:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949230:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788725965.949235:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791517312:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791517824:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949329:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791518336:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725965.949372:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517056 00000100:00100000:3.0:1788725965.949376:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517056 00000100:00100000:3.0:1788725965.949407:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788725965.949414:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791517056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949453:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1386403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791517056:12345-0@lo:400:kworker.0 Request processed in 39us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.949460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788725965.949578:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517952 00000100:00100000:3.0:1788725965.949583:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517952 00000100:00100000:3.0:1788725965.949615:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791518464 00000100:00100000:3.0:1788725965.949618:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791518464 00000100:00100000:3.0:1788725965.949633:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788725965.949639:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949686:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791517952:12345-0@lo:400:kworker.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.949693:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788725965.949705:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788725965.949711:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791518464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949737:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791518464:12345-0@lo:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.949742:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788725965.949756:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788725965.949760:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725965.949784:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949795:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791518464:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949817:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791517056:0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517184 00000100:00100000:3.0:1788725965.949837:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517184 00000100:00100000:3.0:1788725965.949855:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517696 00000100:00100000:3.0:1788725965.949858:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517696 00000100:00100000:3.0:1788725965.949875:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791518208 00000100:00100000:3.0:1788725965.949878:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791518208 00000100:00100000:3.0:1788725965.949890:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517440 00000100:00100000:3.0:1788725965.949893:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517440 00000100:00100000:3.0:1788725965.949903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517824 00000100:00100000:3.0:1788725965.949905:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517824 00000100:00100000:3.0:1788725965.949918:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791518336 00000100:00100000:3.0:1788725965.949920:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791518336 00000100:00100000:3.0:1788725965.949933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788725965.949939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791517184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.949986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791517184:12345-0@lo:400:kworker.0 Request processed in 46us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.949992:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788725965.950005:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788725965.950011:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b138557dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791517696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725965.950038:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b138557dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791517696:12345-0@lo:400:kworker.0 Request processed in 28us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725965.950044:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788725965.952420:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788725965.952442:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791518208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952522:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791518208:12345-0@lo:400:kworker.0 Request processed in 90us (4251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.952529:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788725965.952549:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788725965.952556:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791517440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952613:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791517440:12345-0@lo:400:kworker.0 Request processed in 57us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.952619:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788725965.952660:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791517440:0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952684:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788725965.952691:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791517824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952729:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791517824:12345-0@lo:400:kworker.0 Request processed in 39us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.952735:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00080000:1.0:1788725965.952760:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d96300 x1875614791517824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725965.952771:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791517824:0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952788:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788725965.952795:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952829:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791518336:12345-0@lo:400:kworker.0 Request processed in 34us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725965.952835:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00080000:1.0:1788725965.952857:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13812aa300 x1875614791518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725965.952867:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791518336:0@lo:400:kworker.0 00000100:00080000:1.0:1788725965.952917:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725965.952921:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725965.952944:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791517184:0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952968:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791517696:0@lo:400:kworker.0 00000100:00100000:1.0:1788725965.952978:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791518208:0@lo:400:kworker.0 00000100:00100000:0.0:1788725965.953147:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791516928 00000100:00100000:0.0:1788725965.953165:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791516928 00000100:00100000:0.0:1788725965.953225:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788725965.953232:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791516928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788725965.953254:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788725965.953306:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791516928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (5438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.953313:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788725965.953362:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791516928:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788725965.953739:0:9813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411109620248ns, next at 412109617851ns, rc = 0 00000100:00100000:2.0:1788725965.953762:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791517312 00000100:00100000:2.0:1788725965.953767:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791517312 00000100:00100000:2.0:1788725965.953791:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788725965.953798:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791517312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.953841:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791517312:12345-0@lo:400:kworker.0 Request processed in 44us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725965.953847:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788725965.953877:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791517312:0@lo:400:kworker.0 00000100:00100000:2.0:1788725965.953891:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725965.953901:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791518592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725965.953932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788725965.954076:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725965.954464:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791518592 00000100:00100000:0.0:1788725965.954476:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791518592 00000100:00100000:0.0:1788725965.954510:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788725965.954517:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791518592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788725965.954528:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788725965.954568:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791518592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725965.954574:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788725965.954680:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791518592:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788725966.395350:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725966.395359:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725966.395384:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788725966.395392:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725966.395519:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283694000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791518720:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788725966.395620:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a27d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788725966.410717:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283694000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791518720:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788725966.415203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.415294:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498688 00000100:00100000:2.0:1788725966.415303:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498688 00000100:00100000:2.0:1788725966.415369:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1788725966.415380:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+66:12461:x1875614770498688:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788725966.415411:0:11950:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788725966.415523:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+66:12461:x1875614770498688:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.415547:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 232 00000100:00100000:2.0:1788725966.421377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.421452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770498816 00000100:00100000:1.0:1788725966.421462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770498816 00000100:00100000:1.0:1788725966.421517:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:1.0:1788725966.421527:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+66:12461:x1875614770498816:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788725966.421593:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421625:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421640:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421665:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421673:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421698:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421707:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421713:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725966.421758:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788725966.421762:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725966.421775:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421785:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421791:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421798:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421804:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725966.421808:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421822:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421835:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:1.0:1788725966.421837:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725966.421842:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421847:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e600/0xa13c582691d37dcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421859:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421865:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421871:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421876:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725966.421878:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421883:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421890:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9b1283235800) 00010000:00010000:1.0:1788725966.421892:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725966.421894:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421909:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e000/0xa13c582691d37dd6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421935:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421941:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421946:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421952:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725966.421955:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421960:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421967:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:1.0:1788725966.421969:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725966.421971:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.421977:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ddd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.422052:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+66:12461:x1875614770498816:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 525us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.422060:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 233 00000100:00100000:3.0:1788725966.426353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.426539:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770499072 00000100:00100000:0.0:1788725966.426551:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770499072 00000100:00100000:0.0:1788725966.426616:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:0.0:1788725966.426627:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+66:12461:x1875614770499072:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725966.426647:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725966.426668:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37de4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7122 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.426767:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.426781:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.426793:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788725966.426805:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788725966.426894:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.426903:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427002:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.427013:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427020:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427033:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.427036:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788725966.427041:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427047:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37deb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427086:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37de4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7122 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427096:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725966.427099:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788725966.427103:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37de4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7122 expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.427112:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8400, rc 0) 00000100:00100000:0.0:1788725966.429062:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499072:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 2424us (2706us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788725966.429093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 234 00000100:00100000:2.0:1788725966.442610:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.442688:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770499200 00000100:00100000:1.0:1788725966.442697:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770499200 00000100:00100000:1.0:1788725966.442754:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:1.0:1788725966.442763:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788725966.442794:0:9522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788725966.442925:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499200:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 163us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.442933:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 235 00000100:00100000:2.0:1788725966.448085:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.448368:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770499456 00000100:00100000:0.0:1788725966.448378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770499456 00000100:00100000:0.0:1788725966.448438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:0.0:1788725966.448448:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499456:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788725966.448468:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788725966.448471:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788725966.448496:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045800/0xa13c582691d37d89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7106 expref: 67 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.448515:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725966.448520:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725966.448532:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37df9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7129 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788725966.448891:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788725966.449031:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37e00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.449045:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37e00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.449055:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37e00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.449104:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8400/0xa13c582691d37df9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7129 expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.449195:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37e00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7129 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.449203:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b1394485100) 00010000:00010000:0.0:1788725966.449205:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725966.449208:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788725966.449267:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+68:12461:x1875614770499456:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 820us (1191us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788725966.449275:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 236 00000100:00100000:2.0:1788725966.456775:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.459294:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770499712 00000100:00100000:0.0:1788725966.459309:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770499712 00000100:00100000:0.0:1788725966.459379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:0.0:1788725966.459390:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+68:12461:x1875614770499712:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788725966.459447:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725966.459474:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9400/0xa13c582691d37e00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7129 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459494:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b1394485100) 00010000:00010000:0.0:1788725966.459506:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788725966.459525:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459538:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459546:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459575:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459583:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459589:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459629:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459635:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459641:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459646:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.459650:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459657:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459664:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725966.459667:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.459670:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459676:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9e00/0xa13c582691d37e0e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459690:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459696:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459701:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459706:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.459708:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459713:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459720:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfeb0bd03 (ffff9b1394485000) 00010000:00010000:0.0:1788725966.459722:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.459725:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.459729:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e15 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfeb0bd03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.459815:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499712:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 426us (3048us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788725966.459822:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 237 00000100:00100000:2.0:1788725966.463493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.463582:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770499840 00000100:00100000:3.0:1788725966.463592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770499840 00000100:00100000:3.0:1788725966.463648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:3.0:1788725966.463658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+67:12461:x1875614770499840:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725966.463682:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725966.463706:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37e1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7130 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463742:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463754:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463765:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463882:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37e1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463914:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.463923:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725966.463927:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788725966.463930:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380030400, rc 0) 00000100:00100000:3.0:1788725966.464033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+68:12461:x1875614770499840:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 376us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725966.464039:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 238 00000100:00100000:2.0:1788725966.472223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.472381:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500096 00000100:00100000:0.0:1788725966.472391:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500096 00000100:00100000:0.0:1788725966.472452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:0.0:1788725966.472477:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+68:12461:x1875614770500096:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788725966.472560:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.472576:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.472587:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788725966.472740:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1788725966.472787:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d52276da reply state 00000000cbf89b65 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.472801:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.472809:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725966.472812:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788725966.472815:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788725966.472911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+70:12461:x1875614770500096:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 435us (695us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788725966.472918:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 239 00000100:00100000:1.0:1788725966.475377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.475466:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500224 00000100:00100000:2.0:1788725966.475475:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500224 00000100:00100000:2.0:1788725966.475531:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1788725966.475541:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+70:12461:x1875614770500224:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788725966.475565:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725966.475585:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7137 expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.475641:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 71 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.475655:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 71 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.475673:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725966.475676:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788725966.475679:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7e00, rc 0) 00000100:00100000:2.0:1788725966.475726:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+71:12461:x1875614770500224:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 187us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.475749:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 240 00000100:00100000:2.0:1788725966.481396:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.481485:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500352 00000100:00100000:3.0:1788725966.481494:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500352 00000100:00100000:3.0:1788725966.481568:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00100000:3.0:1788725966.481579:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770500352:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788725966.481796:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+10:2395:x1875614770500352:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 219us (409us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788725966.481804:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 70 00000100:00080000:1.0:1788725966.481881:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788725966.488806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.488944:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500608 00000100:00100000:3.0:1788725966.488954:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500608 00000100:00100000:3.0:1788725966.489014:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:3.0:1788725966.489025:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+71:12461:x1875614770500608:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725966.489285:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+72:12461:x1875614770500608:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 262us (487us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788725966.489293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:0.0:1788725966.491632:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.491731:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500864 00000100:00100000:2.0:1788725966.491740:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500864 00000100:00100000:2.0:1788725966.491796:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:2.0:1788725966.491806:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+72:12461:x1875614770500864:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788725966.491924:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+72:12461:x1875614770500864:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.491932:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 241 00000100:00100000:1.0:1788725966.494539:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.494617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770500992 00000100:00100000:3.0:1788725966.494636:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770500992 00000100:00100000:3.0:1788725966.494688:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:3.0:1788725966.494698:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+72:12461:x1875614770500992:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725966.494716:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725966.494734:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37e38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a713e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494799:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494812:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494823:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725966.494880:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788725966.494898:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494923:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031a00/0xa13c582691d37e38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a713e expref: 74 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494940:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a713e expref: 73 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.494949:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725966.494951:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788725966.494955:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1380031000, rc 0) 00000100:00100000:3.0:1788725966.495008:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+73:12461:x1875614770500992:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 311us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725966.495021:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 242 00000100:00100000:3.0:1788725966.498433:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.498574:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501120 00000100:00100000:1.0:1788725966.498584:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501120 00000100:00100000:1.0:1788725966.498643:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:1.0:1788725966.498655:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+10:2398:x1875614770501120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788725966.498672:0:8425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725966.498690:0:8425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7145 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725966.498716:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcacd, blocks: 0x0 00010000:00010000:1.0:1788725966.498733:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1788725966.498738:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725966.498746:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.498764:0:8425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 11 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.498794:0:8425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e600, rc 0) 00000100:00100000:1.0:1788725966.498992:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+11:2398:x1875614770501120:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 339us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.499000:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 71 00000100:00100000:0.0:1788725966.504040:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.504254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501376 00000100:00100000:3.0:1788725966.504264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501376 00000100:00100000:2.0:1788725966.504435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:2.0:1788725966.504446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+73:12461:x1875614770501376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788725966.504580:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+73:12461:x1875614770501376:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 135us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.504587:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 243 00000100:00100000:2.0:1788725966.507331:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.507405:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501504 00000100:00100000:3.0:1788725966.507414:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501504 00000100:00100000:3.0:1788725966.507463:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:3.0:1788725966.507473:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+11:12461:x1875614770501504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725966.507488:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725966.507506:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a714c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.507535:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.507544:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725966.507547:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788725966.507552:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.507584:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 12 pid: 8425 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.507597:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 12 pid: 8425 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725966.507629:0:8427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791518848:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788725966.507724:0:8427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788725966.510615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.510708:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501632 00000100:00100000:1.0:1788725966.510718:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501632 00010000:00010000:1.0:1788725966.510763:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 13 pid: 8425 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.510806:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788725966.510817:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+13:2395:x1875614770501632:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725966.510832:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725966.510866:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 13 pid: 8425 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.510881:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 13 pid: 8425 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.510902:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725966.510907:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725966.510915:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.510925:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.510973:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 13 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.510987:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283694700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791518976:192.168.203.12@tcp:105: 00000100:00100000:1.0:1788725966.511065:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a27d840 going to sleep for 11 seconds 00010000:00010000:3.0:1788725966.511851:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c45b5c49/0xa13c582691d37e46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7145 expref: 13 pid: 8425 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725966.511869:0:8427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8427:1875614791518848:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788725966.511893:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 12 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.511904:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8fc00, rc 0) 00000100:00100000:3.0:1788725966.511988:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+12:12461:x1875614770501504:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4516us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725966.511997:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 72 00000100:00100000:1.0:1788725966.514970:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283694700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1875614791518976:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788725966.514999:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725966.515057:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:78ae299a-14d0-4856-aa24-442bf24804dd+11:2395:x1875614770501632:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4241us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.515068:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788725966.519548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.519632:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501760 00000100:00100000:3.0:1788725966.519643:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501760 00002000:00100000:3.0:1788725966.519700:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9b1283694700 x1875614770501760/t0(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:362/0 lens 504/0 e 0 to 0 dl 1788725977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725966.519712:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283694700 with x1875614770501760 ext(0->12) 00002000:00010000:3.0:1788725966.519718:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283694700 00000100:00100000:3.0:1788725966.519754:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:3.0:1788725966.519765:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+11:2398:x1875614770501760:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788725966.520771:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:78ae299a-14d0-4856-aa24-442bf24804dd+13:2398:x1875614770501760:12345-192.168.203.12@tcp:4:lhsmtool_posix.0 Request processed in 1001us (1226us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788725966.520794:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00002000:00100000:3.0:1788725966.520804:0:8430:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9b1283694700 x1875614770501760/t4294967321(0) o4->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:362/0 lens 504/448 e 0 to 0 dl 1788725977 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725966.520812:0:8430:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283694700 with x1875614770501760 ext(0->12) 00002000:00010000:3.0:1788725966.520817:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283694700 00000100:00100000:2.0:1788725966.523253:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.523396:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770501888 00000100:00100000:0.0:1788725966.523407:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770501888 00000100:00100000:0.0:1788725966.523464:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:0.0:1788725966.523486:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+73:12461:x1875614770501888:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788725966.526357:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788725966.526380:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788725966.526414:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788725966.526436:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b12824f1d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788725966.526440:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e5c2600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b12824f1600 00000020:00080000:1.0:1788725966.526443:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b139e5c2d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283cfc600 00000004:00080000:1.0:1788725966.526469:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788725966.526490:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b13a94b73c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788725966.526494:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b1385c06900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b13a94b7240 00000020:00080000:1.0:1788725966.526497:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b1385c06c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b12835baa00 00000020:00080000:1.0:1788725966.526520:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788725966.526579:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788725966.526710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+27:12461:x1875614770501888:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 3220us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.526720:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 244 00000100:00100000:2.0:1788725966.527203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791519104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788725966.527255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725966.527303:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791519104 00000100:00100000:2.0:1788725966.527319:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791519104 00000100:00100000:2.0:1788725966.527363:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788725966.527372:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791519104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788725966.527396:0:8716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1788725966.527428:0:8716:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9dcacc, atime: 0x6a9dcacc, ctime: 0x6a9dcacc, blocks: 0x8 00010000:00010000:2.0:1788725966.527445:0:8716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.527462:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788725966.527466:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725966.527474:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.527490:0:8716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.527499:0:8716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.527507:0:8716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.527524:0:8716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788725966.527642:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791519104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 270us (386us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788725966.527649:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1788725966.527685:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b13812aa680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788725966.527691:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791519104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788725966.530236:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725966.530257:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791519232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788725966.530330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725966.530375:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791519232 00000100:00100000:2.0:1788725966.530393:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791519232 00000100:00100000:2.0:1788725966.530436:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788725966.530445:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791519232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788725966.530469:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788725966.530492:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.530512:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.530520:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788725966.530524:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725966.530528:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.530555:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 12 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.530569:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 12 pid: 8425 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.530580:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791519360:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725966.530633:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209900 going to sleep for 11 seconds 00010000:00010000:0.0:1788725966.530862:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530872:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530879:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530885:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.530889:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530896:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530910:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9b1394485400) 00010000:00010000:0.0:1788725966.530913:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.530917:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530922:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37b52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530960:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530967:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530972:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530984:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fc00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.530987:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.530992:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531000:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9b1394485e00) 00010000:00010000:0.0:1788725966.531002:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.531005:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531110:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fc00/0xa13c582691d37bfa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531159:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531265:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531271:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531276:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.531279:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531285:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531304:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:0.0:1788725966.531306:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.531309:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531326:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d37c78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531341:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531346:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531351:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531356:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.531359:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531364:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531371:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283235500) 00010000:00010000:0.0:1788725966.531373:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.531376:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531382:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d37c9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531405:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531411:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531417:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531422:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.531426:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531431:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531439:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.531441:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.531444:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531448:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7800/0xa13c582691d37d6d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531461:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531466:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531471:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531482:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.531485:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531491:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531499:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725966.531503:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788725966.531506:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.531510:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9a00/0xa13c582691d37e2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531682:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725966.531691:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531699:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725966.531703:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531711:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531725:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531731:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1dc30b/0xa13c582691d37e54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.531746:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.531748:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.531749:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725966.534156:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.534377:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502016 00000100:00100000:0.0:1788725966.534387:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502016 00000100:00100000:0.0:1788725966.534430:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1788725966.534439:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+13:2397:x1875614770502016:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788725966.537525:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788725966.537546:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:0.0:1788725966.537911:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2397:x1875614770502016:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 3466us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725966.537922:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:0.0:1788725966.540194:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.540470:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8426:1875614791519360:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725966.540521:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.541305:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502144 00000100:00100000:1.0:1788725966.541321:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502144 00010000:00010000:1.0:1788725966.541358:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.541401:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1788725966.541410:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2396:x1875614770502144:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725966.541423:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725966.541429:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.541441:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.541464:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b8c6893/0xa13c582691d37c08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70a4 expref: 8 pid: 8425 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.541477:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788725966.541481:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788725966.541486:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.541505:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725966.541542:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725966.541599:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770502144:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 189us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.541606:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00010000:00010000:2.0:1788725966.541691:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.541701:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.541710:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.541718:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.541742:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788725966.541923:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791519232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11478us (11593us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788725966.541931:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788725966.541985:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725966.541992:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.542000:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725966.542004:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.542021:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.542034:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.542041:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d37e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.542056:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.542058:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.542059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725966.542288:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1788725966.542295:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1788725966.543808:0:3639:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9b1283d94a80 x1875614791519232/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788725982 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788725966.543825:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b1283d94a80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788725966.543834:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791519232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788725966.546483:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.547457:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502400 00000100:00100000:2.0:1788725966.547468:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502400 00000100:00100000:2.0:1788725966.547626:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:2.0:1788725966.547648:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+21:12461:x1875614770502400:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788725966.547700:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725966.547726:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380031000/0xa13c582691d37e3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a713e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.547765:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725966.547770:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725966.547799:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.547811:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.547820:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788725966.547955:0:9522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002308b9e8 reply state 00000000f132a282 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.547966:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.547973:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725966.547976:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788725966.547979:0:9522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788725966.548650:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:12461:x1875614770502400:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1013us (2173us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788725966.548658:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 245 00000100:00100000:0.0:1788725966.551551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.551627:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502528 00000100:00100000:1.0:1788725966.551636:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502528 00000100:00100000:1.0:1788725966.551689:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:1.0:1788725966.551699:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2398:x1875614770502528:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788725966.551857:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788725966.551861:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788725964 00002000:00010000:1.0:1788725966.551864:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788725964 00002000:00010000:1.0:1788725966.551866:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788725965 -> 1788725964 00002000:00010000:1.0:1788725966.551868:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788725966.551930:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770502528:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 231us (388us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788725966.551936:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:0.0:1788725966.555686:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.555777:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502784 00000100:00100000:2.0:1788725966.555786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502784 00000100:00100000:2.0:1788725966.555880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:2.0:1788725966.555891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+22:12461:x1875614770502784:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788725966.555956:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.555985:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.555995:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.556041:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.556056:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 22 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.556070:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791519488:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725966.556498:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725966.561588:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.561728:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770502912 00000100:00100000:0.0:1788725966.561737:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770502912 00010000:00010000:0.0:1788725966.561774:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 23 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.561819:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1788725966.561830:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+23:2395:x1875614770502912:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725966.561849:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725966.561856:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 23 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.561869:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 23 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.561891:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725966.561896:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.561905:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.561912:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.561931:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725966.561990:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+23:2395:x1875614770502912:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 162us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725966.561998:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00010000:00010000:2.0:1788725966.563784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1380030400/0xa13c582691d37e23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7130 expref: 22 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.563804:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791519488:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725966.563826:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563836:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563904:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563943:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563960:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563967:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563972:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725966.563976:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563984:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.563997:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:2.0:1788725966.564000:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788725966.564004:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.564010:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e69 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.564326:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+21:12461:x1875614770502784:12345-192.168.203.12@tcp:55:lhsmtool_posix.0 Request processed in 8435us (8646us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788725966.564335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 246 00000100:00100000:1.0:1788725966.567330:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.567482:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503040 00000100:00100000:2.0:1788725966.567492:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503040 00000100:00100000:2.0:1788725966.567552:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:2.0:1788725966.567562:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2397:x1875614770503040:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788725966.567601:0:8716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.567631:0:8716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.567640:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788725966.567644:0:8716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725966.567649:0:8716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.567684:0:8716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.567698:0:8716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 8 pid: 8427 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.567712:0:8716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8716:1875614791519616:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725966.567785:0:8716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788725966.570857:0:8716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8716:1875614791519616:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725966.570886:0:8716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.572759:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.573383:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503168 00000100:00100000:2.0:1788725966.573395:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503168 00010000:00010000:2.0:1788725966.573435:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 9 pid: 8427 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.573509:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788725966.573520:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+9:2395:x1875614770503168:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725966.573533:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725966.573555:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 9 pid: 8427 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.573568:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 9 pid: 8427 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.573590:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006901bef2/0xa13c582691d37e4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a714c expref: 9 pid: 8427 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.573605:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725966.573610:0:10330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788725966.573616:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.573625:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.573649:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725966.573710:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+8:2395:x1875614770503168:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 192us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.573718:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00010000:00010000:0.0:1788725966.573860:0:8716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573871:0:8716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573897:0:8716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573905:0:8716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573914:0:8716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573921:0:8716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788725966.573925:0:8716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573935:0:8716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573946:0:8716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.573954:0:8716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d37e70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.574001:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770503040:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 6440us (6688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725966.574008:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:1.0:1788725966.577664:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.577737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503424 00000100:00100000:0.0:1788725966.577747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503424 00000100:00100000:0.0:1788725966.577799:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 247 00000100:00100000:0.0:1788725966.577809:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+21:12461:x1875614770503424:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788725966.577893:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.577908:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 21 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.577918:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.577951:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 21 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.577965:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 21 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.577979:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791519744:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725966.578068:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788725966.580856:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791519744:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725966.580886:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725966.582368:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.582530:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503552 00000100:00100000:0.0:1788725966.582539:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503552 00010000:00010000:0.0:1788725966.582572:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.582627:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 102 00000100:00100000:0.0:1788725966.582636:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+22:2396:x1875614770503552:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725966.582650:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725966.582656:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582668:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582686:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37d66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a70f8 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582701:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.582706:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582716:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582723:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582730:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.582761:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725966.582806:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+21:2396:x1875614770503552:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 172us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725966.582818:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 102 00010000:00010000:2.0:1788725966.583112:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583155:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583322:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583334:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 21 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583345:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583373:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 21 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.583386:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 21 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.583397:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791519872:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788725966.583448:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209300 going to sleep for 11 seconds 00000100:00100000:1.0:1788725966.588774:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.588946:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503680 00000100:00100000:3.0:1788725966.588956:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503680 00010000:00010000:3.0:1788725966.588994:0:10330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788725966.589039:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:3.0:1788725966.589048:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:2395:x1875614770503680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725966.589059:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725966.589078:0:10330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.589091:0:10330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 22 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.589112:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725966.589150:0:10330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.589162:0:10330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.589179:0:10330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.589199:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725966.589245:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:2395:x1875614770503680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 197us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725966.589252:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00010000:00010000:2.0:1788725966.589729:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7137 expref: 21 pid: 9522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.589748:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791519872:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788725966.589768:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.589789:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.589795:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788725966.589896:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788725966.590000:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788725966.590426:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788725966.591733:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875614791520000:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788725966.591796:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725966.591877:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788725966.592711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791520000 00000100:00100000:1.0:1788725966.592721:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791520000 00000100:00100000:1.0:1788725966.592817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788725966.592827:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6511:x1875614791520000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788725966.592950:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6511:x1875614791520000:12345-0@lo:1000:mdt00_001.0 Request processed in 125us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725966.592958:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788725966.593049:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875614791520000:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788725966.593226:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788725966.593303:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875614791520128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788725966.593345:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725966.593850:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725966.593972:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791520128 00000100:00100000:2.0:1788725966.593978:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791520128 00000100:00100000:2.0:1788725966.594022:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788725966.594031:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1875614791520128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788725966.594325:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1875614791520128:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788725966.594362:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594372:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594380:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594386:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.594391:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594398:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594413:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:0.0:1788725966.594416:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725966.594421:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594427:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e7e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594466:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594473:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594479:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594484:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.594487:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594503:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594512:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.594515:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725966.594521:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594533:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594542:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.594569:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.594594:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791520256:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788725966.596341:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283474a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788725966.596623:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6511:x1875614791520128:12345-0@lo:1000:mdt00_001.0 Request processed in 2461us (3145us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788725966.596635:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788725966.599696:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725966.599839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770503808 00000100:00100000:3.0:1788725966.599857:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770503808 00000100:00100000:3.0:1788725966.599911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:3.0:1788725966.599921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:12460:x1875614770503808:12345-192.168.203.12@tcp:49:lfs.0 00000100:00100000:3.0:1788725966.600417:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+25:12460:x1875614770503808:12345-192.168.203.12@tcp:49:lfs.0 Request processed in 494us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725966.600426:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788725966.600548:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1875614791520256:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788725966.600573:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600583:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044e00/0xa13c582691d37dc1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600616:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600629:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600641:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600650:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600656:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600662:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600668:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.600672:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600692:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600704:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.600706:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725966.600710:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600716:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8000/0xa13c582691d37e85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600725:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600730:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600736:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600741:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788725966.600743:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600749:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600755:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.600757:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788725966.600760:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.600775:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9200/0xa13c582691d37e77 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.600902:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:12461:x1875614770503424:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 23094us (23246us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788725966.600911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 247 00000020:00080000:0.0:1788725966.600914:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788725966.601531:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725966.601537:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725966.602918:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788725966.602937:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725966.609622:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725966.609670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.609757:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504064 00000100:00100000:2.0:1788725966.609766:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504064 00000100:00100000:2.0:1788725966.609832:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:2.0:1788725966.609851:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:12460:x1875614770504064:12345-192.168.203.12@tcp:58:lfs.0 00000040:00080000:2.0:1788725966.610228:0:9522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788725966.610463:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+24:12460:x1875614770504064:12345-192.168.203.12@tcp:58:lfs.0 Request processed in 621us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.610470:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 248 00000100:00100000:3.0:1788725966.610847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504320 00000100:00100000:3.0:1788725966.610853:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504320 00000100:00100000:3.0:1788725966.610901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:3.0:1788725966.610909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+24:12461:x1875614770504320:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788725966.611143:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788725966.611176:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788725966.611208:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611235:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611243:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611250:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611257:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.611274:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788725966.612616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+26:12461:x1875614770504320:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 1700us (2938us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788725966.612628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000020:00080000:3.0:1788725966.612633:0:6514:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788725966.612682:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725966.612689:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.612712:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788725966.612716:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.612723:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.612737:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:3.0:1788725966.612739:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788725966.612744:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.612749:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37e8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725966.612761:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.612763:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725966.612764:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725966.652762:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725966.652875:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504448 00000100:00100000:2.0:1788725966.652884:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504448 00000100:00100000:2.0:1788725966.652944:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 249 00000100:00100000:2.0:1788725966.652955:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+26:12463:x1875614770504448:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725966.652978:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725966.653018:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7153 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653082:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653096:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653107:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653159:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653171:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653177:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653268:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653279:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 27 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653287:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653330:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 27 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.653344:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 27 pid: 11950 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.653359:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791520384:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788725966.654461:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1282209c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788725966.660390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.660560:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1875614791520384:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788725966.660596:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725966.660819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504704 00000100:00100000:2.0:1788725966.660828:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504704 00000100:00100000:2.0:1788725966.660891:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788725966.660900:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+28:6636:x1875614770504704:12345-192.168.203.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788725966.661608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+29:6636:x1875614770504704:12345-192.168.203.12@tcp:35:ldlm_bl.0 Request processed in 706us (1224us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788725966.661617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:1.0:1788725966.664266:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725966.664389:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504832 00000100:00100000:0.0:1788725966.664399:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504832 00010000:00010000:0.0:1788725966.664437:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 29 pid: 11950 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788725966.664478:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788725966.664486:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab290450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+29:2396:x1875614770504832:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788725966.664513:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725966.664521:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 29 pid: 11950 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664532:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 29 pid: 11950 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664552:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37db3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7114 expref: 29 pid: 11950 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664580:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725966.664584:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664594:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664601:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725966.664633:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788725966.664833:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664851:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725966.664907:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788725966.664911:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788725966.664927:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664950:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664956:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664962:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664967:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725966.664971:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664977:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664987:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:2.0:1788725966.664990:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725966.664993:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.664999:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37e9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665033:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665039:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665046:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665051:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725966.665054:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665060:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665068:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9b1283455e00) 00010000:00010000:2.0:1788725966.665070:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788725966.665073:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665079:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7600/0xa13c582691d37ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665112:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d37e93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7153 expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665455:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7153 expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725966.665477:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725966.665480:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788725966.665483:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7a00, rc 0) 00000100:00100000:0.0:1788725966.665741:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab290450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:78ae299a-14d0-4856-aa24-442bf24804dd+28:2396:x1875614770504832:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1253us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725966.665749:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:2.0:1788725966.665828:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+27:12463:x1875614770504448:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 12874us (13075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.665890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 249 00010000:00010000:3.0:1788725966.721408:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725966.976412:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791520512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725966.976489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725966.976590:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791520512 00000100:00100000:2.0:1788725966.976597:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791520512 00000100:00100000:2.0:1788725966.976655:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788725966.976666:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13a96e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791520512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725966.976696:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725966.981343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13a96e1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791520512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4668us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725966.981358:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788725966.982427:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791520512:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788725967.619602:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788725967.619610:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788725967.619635:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788725967.619644:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725967.619771:0:13788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791520640:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788725967.620389:0:13788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788725967.643232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725967.643277:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770504960 00000100:00100000:1.0:1788725967.643285:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770504960 00000100:00100000:1.0:1788725967.643981:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00100000:1.0:1788725967.643992:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+28:12474:x1875614770504960:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788725967.644026:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788725967.644148:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+28:12474:x1875614770504960:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 158us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725967.644155:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 250 00000100:00080000:1.0:1788725967.644176:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725967.645090:0:13788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875614791520640:192.168.203.12@tcp:107:hsm_cdtr.0 00000040:00080000:3.0:1788725967.647524:0:14699:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788725967.647532:0:14699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788725967.647566:0:14699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788725967.647573:0:14699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788725967.650766:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725967.651883:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770505216 00000100:00100000:3.0:1788725967.651895:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770505216 00000100:00100000:3.0:1788725967.651953:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:3.0:1788725967.651963:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+27:12474:x1875614770505216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788725967.651982:0:9522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788725967.651998:0:9522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e600/0xa13c582691d37eaf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a715a expref: -99 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.652130:0:9522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.652144:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.652164:0:9522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788725967.652175:0:9522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788725967.652266:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e600/0xa13c582691d37eaf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a715a expref: 30 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.652283:0:9522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a715a expref: 29 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.652501:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725967.652506:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788725967.652509:0:9522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f600, rc 0) 00000100:00100000:3.0:1788725967.652565:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+29:12474:x1875614770505216:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 602us (1806us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788725967.652572:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 251 00000100:00100000:3.0:1788725967.666743:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725967.666820:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770505472 00000100:00100000:2.0:1788725967.666829:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770505472 00000100:00100000:2.0:1788725967.666902:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 252 00000100:00100000:2.0:1788725967.666913:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+29:12474:x1875614770505472:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788725967.666986:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667003:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667016:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667219:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667229:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667235:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667242:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788725967.667246:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667254:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667267:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725967.667270:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788725967.667275:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725967.667281:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7000/0xa13c582691d37ec4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788725967.668533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+30:12474:x1875614770505472:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 1614us (1791us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788725967.668546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 252 00000040:00080000:0.0:1788725967.669162:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725967.669168:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788725967.669732:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788725967.669743:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788725967.681524:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725967.681609:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725967.682534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770505728 00000100:00100000:3.0:1788725967.682546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770505728 00000100:00100000:3.0:1788725967.682619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788725967.682630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+30:12474:x1875614770505728:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788725967.682889:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+31:12474:x1875614770505728:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 259us (1372us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788725967.682897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788725967.682922:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770505856 00000100:00100000:3.0:1788725967.682926:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770505856 00000100:00100000:3.0:1788725967.682960:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788725967.682967:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+31:2395:x1875614770505856:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788725967.682976:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725967.683000:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f600/0xa13c582691d37eb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a715a expref: 31 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725967.683017:0:10330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:3.0:1788725967.683021:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725967.683043:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:78ae299a-14d0-4856-aa24-442bf24804dd+30:2395:x1875614770505856:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 77us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725967.683049:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00010000:00010000:3.0:1788725967.740387:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725968.507546:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725968.507569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791520768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725968.507634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725968.507761:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791520768 00000100:00100000:2.0:1788725968.507769:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791520768 00000100:00100000:2.0:1788725968.507814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788725968.507847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791520768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725968.507879:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788725968.507932:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791520768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725968.507939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788725968.508067:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791520768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725968.763543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725969.019275:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725969.019308:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791520896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725969.019375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725969.019467:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791520896 00000100:00100000:2.0:1788725969.019476:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791520896 00000100:00100000:2.0:1788725969.019545:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788725969.019555:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791520896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725969.019583:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725969.019626:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791520896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.019633:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788725969.019705:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725969.019742:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791520896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725969.020574:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725969.020593:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791521024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725969.020632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725969.020785:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521024 00000100:00100000:2.0:1788725969.020806:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521024 00000100:00100000:2.0:1788725969.020857:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788725969.020868:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791521024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725969.020887:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725969.020927:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1875614791521024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.020933:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788725969.020972:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791521024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725969.021155:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725969.085630:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085678:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085723:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085761:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085783:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085806:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.085832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506240 00000100:00100000:2.0:1788725969.085840:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506240 00000100:00100000:2.0:1788725969.085893:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506752 00000100:00100000:2.0:1788725969.085907:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506752 00000100:00100000:2.0:1788725969.085924:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506112 00000100:00100000:2.0:1788725969.085927:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506112 00000100:00100000:2.0:1788725969.085940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506624 00000100:00100000:2.0:1788725969.085942:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506624 00000100:00100000:2.0:1788725969.085958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:2.0:1788725969.085968:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770506240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725969.086038:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770506240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086045:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 327 00000100:00100000:2.0:1788725969.086062:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:2.0:1788725969.086069:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770506752:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725969.086092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770506752:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 328 00000100:00100000:2.0:1788725969.086110:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:2.0:1788725969.086138:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+30:2396:x1875614770506112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725969.086171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+30:2396:x1875614770506112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086177:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 329 00000100:00100000:2.0:1788725969.086198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 330 00000100:00100000:2.0:1788725969.086204:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770506624:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725969.086228:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770506624:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 330 00000100:00100000:2.0:1788725969.086249:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506496 00000100:00100000:2.0:1788725969.086252:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506496 00000100:00100000:2.0:1788725969.086275:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770506368 00000100:00100000:2.0:1788725969.086278:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770506368 00000100:00100000:2.0:1788725969.086306:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788725969.086313:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770506496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788725969.086339:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770506496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086346:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:2.0:1788725969.086359:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:2.0:1788725969.086365:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770506368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725969.086651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770505984 00000100:00100000:0.0:1788725969.086663:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770505984 00000100:00100000:0.0:1788725969.086695:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 390 00000100:00100000:0.0:1788725969.086702:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770505984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725969.086727:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2396:x1875614770505984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725969.086732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 390 00000100:00080000:0.0:1788725969.086763:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788725969.086767:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725969.086769:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725969.086771:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788725969.086977:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770506368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 611us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725969.086985:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000040:00080000:0.0:1788725969.738459:0:14752:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788725969.738469:0:14752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788725969.738501:0:14752:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788725969.738507:0:14752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788725969.787440:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725969.916808:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725969.916879:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507008 00000100:00100000:2.0:1788725969.916900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507008 00000100:00100000:2.0:1788725969.916963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:2.0:1788725969.916974:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+30:12495:x1875614770507008:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788725969.916995:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788725969.917014:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37ecb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7161 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725969.917155:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ed2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725969.917170:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725969.917185:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788725969.917197:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788725969.917308:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6400/0xa13c582691d37ecb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7161 expref: 33 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725969.917325:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7161 expref: 32 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725969.917334:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:2.0:1788725969.917337:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788725969.917341:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6e00, rc 0) 00000100:00100000:2.0:1788725969.917397:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+32:12495:x1875614770507008:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 424us (595us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788725969.917404:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 253 00000100:00100000:3.0:1788725969.925181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725969.928367:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507136 00000100:00100000:1.0:1788725969.928381:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507136 00000100:00100000:1.0:1788725969.928449:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:1.0:1788725969.928460:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+32:12495:x1875614770507136:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:1.0:1788725969.928521:0:11950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928537:0:11950:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928548:0:11950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928590:0:11950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928599:0:11950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928605:0:11950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928611:0:11950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725969.928616:0:11950:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928623:0:11950:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928635:0:11950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:1.0:1788725969.928638:0:11950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788725969.928643:0:11950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725969.928649:0:11950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f400/0xa13c582691d37ee0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725969.928722:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+32:12495:x1875614770507136:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 264us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725969.928730:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 254 00000100:00100000:3.0:1788725970.065353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725970.065450:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507264 00000100:00100000:1.0:1788725970.065460:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507264 00000100:00100000:1.0:1788725970.065517:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788725970.065543:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770507264:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:1.0:1788725970.065561:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725970.065581:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3c8ccb1/0xa13c582691d37ee7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7168 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788725970.065605:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9dcacc, atime: 0x6a9dcacc, ctime: 0x6a9dcacc, blocks: 0x8 00010000:00010000:1.0:1788725970.065625:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1788725970.065630:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788725970.065640:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3c8ccb1/0xa13c582691d37ee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7168 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725970.065658:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3c8ccb1/0xa13c582691d37ee7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7168 expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725970.065672:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:1.0:1788725970.065730:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+8:2397:x1875614770507264:12345-192.168.203.12@tcp:101:cat.0 Request processed in 190us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725970.065737:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788725970.071685:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725970.071754:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507392 00000100:00100000:3.0:1788725970.071777:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507392 00002000:00100000:3.0:1788725970.071829:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9b1283697480 x1875614770507392/t0(0) o3->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:366/0 lens 488/0 e 0 to 0 dl 1788725981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725970.071841:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283697480 with x1875614770507392 ext(0->4095) 00002000:00010000:3.0:1788725970.071847:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283697480 00000100:00100000:3.0:1788725970.071883:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:3.0:1788725970.071893:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770507392:12345-192.168.203.12@tcp:3:cat.0 00000100:00100000:3.0:1788725970.072062:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:78ae299a-14d0-4856-aa24-442bf24804dd+8:2398:x1875614770507392:12345-192.168.203.12@tcp:3:cat.0 Request processed in 170us (388us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788725970.072070:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00002000:00100000:3.0:1788725970.072077:0:8431:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9b1283697480 x1875614770507392/t0(0) o3->78ae299a-14d0-4856-aa24-442bf24804dd@192.168.203.12@tcp:366/0 lens 488/4536 e 0 to 0 dl 1788725981 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788725970.072086:0:8431:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b1283697480 with x1875614770507392 ext(0->4095) 00002000:00010000:3.0:1788725970.072089:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b1283697480 00010000:00010000:3.0:1788725970.815511:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725971.070712:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791521152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725971.070780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725971.070966:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521152 00000100:00100000:2.0:1788725971.070974:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521152 00000100:00100000:2.0:1788725971.071022:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788725971.071032:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791521152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725971.071073:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725971.071134:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791521152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725971.071141:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788725971.071162:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725971.071196:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791521152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725971.071378:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791521280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.071453:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521280 00000100:00100000:1.0:1788725971.071457:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521280 00000100:00100000:1.0:1788725971.071485:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788725971.071492:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791521280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071528:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791521280:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725971.071541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788725971.071591:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791521280:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791521408:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.071707:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725971.071714:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791521536:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.071770:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791521664:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.071791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725971.075879:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521408 00000100:00100000:2.0:1788725971.075893:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521408 00000100:00100000:2.0:1788725971.075961:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521664 00000100:00100000:2.0:1788725971.075965:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521664 00000100:00100000:2.0:1788725971.075991:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788725971.076003:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.076088:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788725971.076100:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791521408:12345-0@lo:400:kworker.0 Request processed in 99us (4435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725971.076102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725971.076132:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788725971.076168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521536 00000100:00100000:2.0:1788725971.076173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521536 00000100:00100000:2.0:1788725971.076199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788725971.076206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.076256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875614791521664:12345-0@lo:400:kworker.0 Request processed in 158us (4463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725971.076264:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788725971.076395:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791521792:0@lo:400:kworker.0 00000100:00100000:2.0:1788725971.078996:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791521536:12345-0@lo:400:kworker.0 Request processed in 2781us (7247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725971.079008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788725971.079077:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791521408:0@lo:400:kworker.0 00000004:00080000:2.0:1788725971.079158:0:9813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416235039395ns, next at 417235037284ns, rc = 0 00000100:00100000:2.0:1788725971.079189:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791521920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725971.079233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725971.079266:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521920 00000100:00100000:2.0:1788725971.079271:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521920 00000100:00100000:2.0:1788725971.079324:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788725971.079331:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791521920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725971.079350:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725971.079386:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791521920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725971.079392:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788725971.079407:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725971.079430:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791521920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725971.080264:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791522048:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080313:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725971.080364:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725971.080369:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791522176:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725971.080416:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522048 00000100:00100000:0.0:1788725971.080421:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522048 00000100:00100000:0.0:1788725971.080460:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522176 00000100:00100000:0.0:1788725971.080463:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522176 00000100:00100000:0.0:1788725971.080485:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788725971.080493:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791522048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080535:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791522048:12345-0@lo:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725971.080541:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788725971.080583:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788725971.080590:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791522176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080629:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791522176:12345-0@lo:400:kworker.0 Request processed in 40us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725971.080634:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:0.0:1788725971.080649:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725971.080653:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788725971.080671:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b12833bf100 x1875614791522176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725971.080682:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791522176:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080691:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791522048:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080722:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788725971.080728:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791522304:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.080752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725971.080778:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522304 00000100:00100000:0.0:1788725971.080782:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522304 00000100:00100000:1.0:1788725971.081875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.081929:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791521792 00000100:00100000:1.0:1788725971.081935:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791521792 00000100:00100000:1.0:1788725971.081965:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788725971.081972:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791521792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.082012:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791521792:12345-0@lo:400:kworker.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725971.082018:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788725971.082049:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791521792:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.082100:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725971.082107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791522432:0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.082148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.082170:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522432 00000100:00100000:1.0:1788725971.082173:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522432 00000100:00100000:3.0:1788725971.082510:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875614791521664:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.082927:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788725971.082942:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791522304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.082986:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791522304:12345-0@lo:400:kworker.0 Request processed in 49us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725971.088393:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788725971.088415:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875614791522432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.088505:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875614791522432:12345-0@lo:400:kworker.0 Request processed in 100us (6355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725971.088512:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788725971.090944:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791521536:0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.091024:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791522304:0@lo:400:kworker.0 00000100:00080000:3.0:1788725971.091041:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725971.091352:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791522432:0@lo:400:kworker.0 00000100:00100000:0.0:1788725971.093745:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788725971.093892:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791522560:0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.093963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725971.094001:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725971.094008:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791522688:0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.094031:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725971.094112:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522560 00000100:00100000:0.0:1788725971.094138:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522560 00000100:00100000:0.0:1788725971.094192:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522688 00000100:00100000:0.0:1788725971.094195:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522688 00000100:00100000:3.0:1788725971.094210:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788725971.094223:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725971.094264:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788725971.094276:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791522688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.094295:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791522560:12345-0@lo:400:kworker.0 Request processed in 75us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725971.094303:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1788725971.094305:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725971.094312:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788725971.094338:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791522688:12345-0@lo:400:kworker.0 Request processed in 64us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725971.094348:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00080000:3.0:1788725971.094349:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842adf80 x1875614791522688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725971.094363:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791522688:0@lo:400:kworker.0 00000100:00100000:3.0:1788725971.094374:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791522560:0@lo:400:kworker.0 00000001:00080000:2.0:1788725971.582336:0:8420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:1.0:1788725971.586660:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1788725971.586696:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788725971.586719:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b1283474540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788725971.586723:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13910c8f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b1283474c00 00000020:00080000:1.0:1788725971.586727:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b13910c8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b12823e7e00 00000020:00080000:1.0:1788725971.586742:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788725971.586761:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586772:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586779:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586785:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788725971.586802:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586810:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586838:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9b13ab2f2000) 00010000:00010000:1.0:1788725971.586841:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788725971.586845:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725971.586852:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6a00/0xa13c582691d37e62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788725971.586887:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788725971.586945:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788725971.587831:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725971.587858:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791522816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788725971.587954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725971.588402:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522816 00000100:00100000:1.0:1788725971.588414:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522816 00000100:00100000:1.0:1788725971.588471:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788725971.588481:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13bea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791522816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788725971.588658:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788725971.588662:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788725964 -> 1788725964 00002000:00010000:1.0:1788725971.588665:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788725964 -> 1788725964 00002000:00010000:1.0:1788725971.588667:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788725964 -> 1788725964 00002000:00010000:1.0:1788725971.588670:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788725971.588729:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13bea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1875614791522816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (774us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788725971.588751:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:1.0:1788725971.590719:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b1283d97100/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788725971.590736:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791522816:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788725971.606619:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788725971.606646:0:9505:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1788725971.835792:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725972.094148:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788725972.094179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791522944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725972.094252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725972.094485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791522944 00000100:00100000:3.0:1788725972.094493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791522944 00000100:00100000:3.0:1788725972.094604:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788725972.094615:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791522944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725972.094649:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725972.094696:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791522944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725972.094703:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788725972.094856:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791522944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788725972.859650:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725973.628908:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791523072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788725973.628993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725973.631256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523072 00000100:00100000:1.0:1788725973.631280:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523072 00000100:00100000:1.0:1788725973.631344:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788725973.631356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791523072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788725973.631399:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788725973.631488:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791523072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725973.631494:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788725973.631547:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791523072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788725973.883630:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725974.139638:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791523200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725974.139737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725974.139831:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791523328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725974.139859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725974.145369:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523200 00000100:00100000:2.0:1788725974.145384:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523200 00000100:00100000:2.0:1788725974.145454:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523328 00000100:00100000:2.0:1788725974.145459:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523328 00000100:00100000:2.0:1788725974.145492:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788725974.145504:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791523200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725974.146159:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725974.146243:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791523200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 740us (6504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725974.146252:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788725974.146388:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788725974.146397:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791523328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725974.146410:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725974.146441:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791523328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725974.146447:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788725974.146511:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788725974.146596:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b13812aa680, transno 4294967311 00000100:00100000:2.0:1788725974.146617:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791523200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788725974.147423:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725974.147504:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791523328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788725974.207080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725974.207143:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507520 00000100:00100000:0.0:1788725974.207157:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507520 00000100:00100000:0.0:1788725974.207313:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 392 00000100:00100000:0.0:1788725974.207327:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2397:x1875614770507520:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725974.207387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725974.207445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2397:x1875614770507520:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725974.207448:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507648 00000100:00100000:1.0:1788725974.207453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507648 00000100:00100000:0.0:1788725974.207455:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 392 00000100:00100000:1.0:1788725974.207500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 337 00000100:00100000:1.0:1788725974.207507:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+18:2397:x1875614770507648:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725974.208170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725974.208202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725974.208222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725974.208236:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725974.208271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00080000:0.0:1788725974.208532:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788725974.208592:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507776 00000100:00100000:0.0:1788725974.208665:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507776 00000100:00100000:3.0:1788725974.208695:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508160 00000100:00100000:3.0:1788725974.208704:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508160 00000100:00100000:0.0:1788725974.208714:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508288 00000100:00100000:0.0:1788725974.208722:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508288 00000100:00100000:0.0:1788725974.208757:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 338 00000100:00100000:0.0:1788725974.208768:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770507776:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725974.208773:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 339 00000100:00100000:3.0:1788725974.208792:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2397:x1875614770508288:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725974.208847:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770507776:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 79us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725974.208855:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 338 00000100:00100000:0.0:1788725974.208876:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 340 00000100:00100000:0.0:1788725974.208883:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2397:x1875614770508160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725974.209164:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed75931d-dab3-4684-a02c-ea7022155724+5:2397:x1875614770508288:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 373us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725974.209167:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed75931d-dab3-4684-a02c-ea7022155724+5:2397:x1875614770508160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 281us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725974.209192:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 339 00000100:00100000:0.0:1788725974.209208:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 340 00000100:00100000:3.0:1788725974.209235:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770507904 00000100:00080000:0.0:1788725974.209239:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725974.209243:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770507904 00000100:00080000:0.0:1788725974.209245:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725974.209290:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788725974.209319:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508032 00000100:00100000:3.0:1788725974.209326:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508032 00000100:00100000:3.0:1788725974.209366:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:0.0:1788725974.209382:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:3.0:1788725974.209383:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770507904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725974.209402:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770508032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725974.209433:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2397:x1875614770507904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 55us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725974.209441:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:0.0:1788725974.209451:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:78ae299a-14d0-4856-aa24-442bf24804dd+7:2397:x1875614770508032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 54us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725974.209461:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00080000:0.0:1788725974.209508:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725974.210955:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:78ae299a-14d0-4856-aa24-442bf24804dd+18:2397:x1875614770507648:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3437us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725974.210969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 337 00010000:00010000:3.0:1788725974.909686:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725975.177684:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725975.177773:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508416 00000100:00100000:3.0:1788725975.177810:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508416 00000100:00100000:3.0:1788725975.177872:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:3.0:1788725975.177883:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:12148:x1875614770508416:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788725975.178007:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:78ae299a-14d0-4856-aa24-442bf24804dd+18:12148:x1875614770508416:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 126us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725975.178015:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 255 00000100:00100000:0.0:1788725975.184881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725975.185268:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508544 00000100:00100000:1.0:1788725975.185279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508544 00000100:00100000:1.0:1788725975.185372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:1.0:1788725975.185383:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:12148:x1875614770508544:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788725975.185506:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:78ae299a-14d0-4856-aa24-442bf24804dd+5:12148:x1875614770508544:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 124us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725975.185528:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 256 00000100:00100000:1.0:1788725975.199367:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725975.199446:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508800 00000100:00100000:2.0:1788725975.199459:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508800 00000100:00100000:2.0:1788725975.199521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788725975.199532:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:12148:x1875614770508800:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788725975.199891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:12148:x1875614770508800:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 360us (533us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788725975.199900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 65 00000100:00100000:2.0:1788725975.454164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725975.454245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770508928 00000100:00100000:1.0:1788725975.454265:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770508928 00000100:00100000:1.0:1788725975.454337:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 257 00000100:00100000:1.0:1788725975.454347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:12953:x1875614770508928:12345-192.168.203.12@tcp:101:lsof.0 00010000:00010000:1.0:1788725975.454366:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788725975.454412:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37eee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a716f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454478:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454490:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454500:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788725975.454556:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788725975.454560:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788725975.454593:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454617:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949fe00/0xa13c582691d37eee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a716f expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454633:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a716f expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725975.454678:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:1.0:1788725975.454681:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788725975.454685:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788725975.454751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:12953:x1875614770508928:12345-192.168.203.12@tcp:101:lsof.0 Request processed in 405us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725975.454758:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 257 00000040:00080000:2.0:1788725975.611868:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788725975.867457:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788725975.867467:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788725975.867559:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788725975.867567:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788725975.931338:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725976.189996:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791523840:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190152:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791524352:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190211:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791524864:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190278:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788725976.190284:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791523456:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190332:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791523968:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190382:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791524480:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791524992:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190429:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190456:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791523712:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791524224:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190521:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791524736:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190555:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788725976.190560:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791523584:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190612:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791524096:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190644:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791524608:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725976.190689:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524352 00000100:00100000:2.0:1788725976.190696:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524352 00000100:00100000:2.0:1788725976.190740:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524864 00000100:00100000:2.0:1788725976.190750:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524864 00000100:00100000:2.0:1788725976.190767:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524480 00000100:00100000:2.0:1788725976.190769:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524480 00000100:00100000:2.0:1788725976.190779:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524992 00000100:00100000:2.0:1788725976.190781:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524992 00000100:00100000:2.0:1788725976.190796:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788725976.190804:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791524352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190853:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791524352:12345-0@lo:400:kworker.0 Request processed in 49us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.190860:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788725976.190877:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788725976.190883:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791524864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190910:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791524864:12345-0@lo:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.190915:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788725976.190924:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788725976.190930:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791524480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.190952:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791524480:12345-0@lo:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.190958:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788725976.190968:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788725976.190975:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791524992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191001:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791524992:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191007:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788725976.191022:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523840 00000100:00100000:2.0:1788725976.191026:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523840 00000100:00100000:2.0:1788725976.191051:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524224 00000100:00100000:2.0:1788725976.191054:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524224 00000100:00100000:2.0:1788725976.191066:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524736 00000100:00100000:2.0:1788725976.191068:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524736 00000100:00100000:2.0:1788725976.191077:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523584 00000100:00100000:2.0:1788725976.191079:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523584 00000100:00100000:2.0:1788725976.191088:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524096 00000100:00100000:2.0:1788725976.191090:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524096 00000100:00100000:2.0:1788725976.191100:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791524608 00000100:00100000:2.0:1788725976.191102:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791524608 00000100:00100000:2.0:1788725976.191139:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788725976.191147:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791523840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191178:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791523840:12345-0@lo:400:kworker.0 Request processed in 33us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191184:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788725976.191195:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788725976.191202:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791524224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191232:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791524224:12345-0@lo:400:kworker.0 Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191238:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788725976.191261:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788725976.191267:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791524736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191293:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875614791524736:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191298:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788725976.191308:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788725976.191313:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191333:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791523584:12345-0@lo:400:kworker.0 Request processed in 21us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191345:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788725976.191356:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788725976.191362:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791524096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191389:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791524096:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191395:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788725976.191404:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788725976.191410:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791524608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191435:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791524608:12345-0@lo:400:kworker.0 Request processed in 26us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725976.191440:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788725976.191478:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791523584:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191488:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791524096:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191497:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791524608:0@lo:400:kworker.0 00010000:00080000:2.0:1788725976.191508:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283d97b80 x1875614791524224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725976.191517:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791524224:0@lo:400:kworker.0 00010000:00080000:2.0:1788725976.191527:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13812aa680 x1875614791524736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725976.191534:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791524736:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191569:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791524480:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191576:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788725976.191587:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b1283d94a80, transno 4294967322 00000004:00080000:2.0:1788725976.191599:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:2.0:1788725976.191614:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b1283d97100, transno 4294967325 00000100:00100000:2.0:1788725976.191619:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791524992:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791523840:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791524352:0@lo:400:kworker.0 00000100:00100000:2.0:1788725976.191648:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791524864:0@lo:400:kworker.0 00000100:00080000:0.0:1788725976.192044:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725976.192049:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725976.192051:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725976.192053:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725976.192162:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791525120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788725976.192229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725976.192274:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725976.192280:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791525248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725976.192301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725976.192339:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523456 00000100:00100000:1.0:1788725976.192344:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523456 00000100:00100000:1.0:1788725976.192378:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788725976.192385:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791523456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725976.192421:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791523456:12345-0@lo:400:kworker.0 Request processed in 37us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725976.192427:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788725976.192454:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523968 00000100:00100000:1.0:1788725976.192457:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523968 00000100:00100000:1.0:1788725976.192478:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791523712 00000100:00100000:1.0:1788725976.192481:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791523712 00000100:00100000:1.0:1788725976.192491:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788725976.192497:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791523968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725976.192530:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791523968:12345-0@lo:400:kworker.0 Request processed in 33us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725976.192545:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788725976.192557:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788725976.192562:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791523712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725976.192592:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791523712:12345-0@lo:400:kworker.0 Request processed in 29us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725976.192598:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788725976.192640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791523456:0@lo:400:kworker.0 00000100:00100000:1.0:1788725976.192650:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791523968:0@lo:400:kworker.0 00000100:00100000:3.0:1788725976.192713:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525120 00000100:00100000:3.0:1788725976.192717:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525120 00000100:00100000:3.0:1788725976.192749:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525248 00000100:00100000:3.0:1788725976.192752:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525248 00000100:00100000:3.0:1788725976.192764:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788725976.192770:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791525120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725976.192788:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788725976.192823:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791525120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725976.192828:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788725976.192839:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788725976.192845:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791525248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788725976.192855:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788725976.192875:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791525248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725976.192880:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788725976.192916:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791525248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725976.192926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791525120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788725976.197799:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791523712:0@lo:400:kworker.0 00010000:00010000:3.0:1788725976.958465:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725977.215842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791525376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788725977.215913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725977.216560:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525376 00000100:00100000:2.0:1788725977.216570:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525376 00000100:00100000:2.0:1788725977.216629:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788725977.216639:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791525376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788725977.216675:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788725977.222993:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791525376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6346us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725977.223018:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788725977.227404:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791525376:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788725977.725366:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788725977.725380:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788725977.725435:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788725977.725445:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788725977.981388:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788725978.361655:0:14949:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:19:36 (1788725976) 00000100:00100000:0.0:1788725978.748593:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791525504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725978.748662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725978.748786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525504 00000100:00100000:2.0:1788725978.748794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525504 00000100:00100000:2.0:1788725978.748846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788725978.748856:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791525504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725978.748888:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788725978.748935:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791525504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725978.748954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788725978.749033:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791525504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788725979.003323:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725979.260313:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725979.260345:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791525632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788725979.260447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725979.260556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791525760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725979.260583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725979.260623:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525632 00000100:00100000:2.0:1788725979.260632:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525632 00000100:00100000:2.0:1788725979.260698:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525760 00000100:00100000:2.0:1788725979.260701:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525760 00000100:00100000:2.0:1788725979.260721:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788725979.260731:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791525632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788725979.260779:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725979.260833:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791525632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725979.260839:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788725979.260858:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788725979.260864:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791525760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725979.260873:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725979.260892:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791525760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725979.260897:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788725979.260912:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725979.260948:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791525760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788725979.260961:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791525632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788725979.328799:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725979.328884:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509056 00000100:00100000:3.0:1788725979.328896:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509056 00000100:00100000:3.0:1788725979.328975:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 394 00000100:00100000:3.0:1788725979.328988:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770509056:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725979.329088:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770509056:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725979.329096:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 394 00000100:00100000:0.0:1788725979.335406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335451:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335483:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335501:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335543:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725979.335573:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509184 00000100:00100000:0.0:1788725979.335584:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509184 00000100:00100000:0.0:1788725979.335649:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509696 00000100:00100000:0.0:1788725979.335652:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509696 00000100:00100000:0.0:1788725979.335663:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509312 00000100:00100000:0.0:1788725979.335665:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509312 00000100:00100000:0.0:1788725979.335677:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509824 00000100:00100000:0.0:1788725979.335679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509824 00000100:00100000:0.0:1788725979.335694:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 347 00000100:00100000:0.0:1788725979.335703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+18:2396:x1875614770509184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725979.335801:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+18:2396:x1875614770509184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 98us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725979.335809:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 347 00000100:00100000:0.0:1788725979.335826:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 348 00000100:00100000:0.0:1788725979.335832:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+6:2396:x1875614770509696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725979.335851:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+6:2396:x1875614770509696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725979.335857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 348 00000100:00100000:0.0:1788725979.335866:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 349 00000100:00100000:0.0:1788725979.335871:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770509312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725979.335889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770509312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 18us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725979.335903:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 349 00000100:00100000:0.0:1788725979.335913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 350 00000100:00100000:0.0:1788725979.335918:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770509824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725979.335937:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2396:x1875614770509824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 19us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725979.335943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 350 00000100:00080000:0.0:1788725979.335961:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725979.335965:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725979.336609:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509440 00000100:00100000:3.0:1788725979.336618:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509440 00000100:00100000:3.0:1788725979.336672:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770509568 00000100:00100000:3.0:1788725979.336675:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770509568 00000100:00100000:3.0:1788725979.336698:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788725979.336706:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770509440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725979.336749:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+5:2396:x1875614770509440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725979.336765:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788725979.336778:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:3.0:1788725979.336784:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770509568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788725979.336803:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:78ae299a-14d0-4856-aa24-442bf24804dd+7:2396:x1875614770509568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 20us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725979.336809:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00080000:0.0:1788725979.338134:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725979.338144:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788725980.029364:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725981.051706:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725981.308324:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791526144:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308434:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791526656:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308465:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791527168:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308498:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788725981.308504:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791526272:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308542:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791526784:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308577:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791527296:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.308624:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526144 00000100:00100000:2.0:1788725981.308632:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526144 00000100:00100000:2.0:1788725981.308681:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788725981.308691:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791526144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.308741:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791526144:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725981.308748:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788725981.308787:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791526144:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.308981:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526784 00000100:00100000:3.0:1788725981.309004:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526784 00000100:00100000:3.0:1788725981.309040:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527296 00000100:00100000:3.0:1788725981.309043:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527296 00000100:00100000:1.0:1788725981.309058:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791526016:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309068:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788725981.309078:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725981.309147:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791526528:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309153:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791526784:12345-0@lo:400:kworker.0 Request processed in 75us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309161:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788725981.309176:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309178:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788725981.309187:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791527296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309200:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791527040:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309242:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791527296:12345-0@lo:400:kworker.0 Request processed in 55us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725981.309248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309255:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788725981.309269:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788725981.309278:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791525888:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309285:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526656 00000100:00100000:3.0:1788725981.309290:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526656 00000100:00100000:3.0:1788725981.309315:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527168 00000100:00100000:1.0:1788725981.309316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309320:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527168 00000100:00100000:3.0:1788725981.309339:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526272 00000100:00100000:3.0:1788725981.309342:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526272 00000100:00100000:1.0:1788725981.309349:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791526400:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309356:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526016 00000100:00100000:3.0:1788725981.309359:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526016 00000100:00100000:3.0:1788725981.309368:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526528 00000100:00100000:3.0:1788725981.309369:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526528 00000100:00100000:3.0:1788725981.309379:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527040 00000100:00100000:3.0:1788725981.309382:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527040 00000100:00100000:3.0:1788725981.309395:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788725981.309401:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791526656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309434:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791526656:12345-0@lo:400:kworker.0 Request processed in 33us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309442:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788725981.309467:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788725981.309469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309478:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791527168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309488:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791526912:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309525:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791527168:12345-0@lo:400:kworker.0 Request processed in 49us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309533:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788725981.309537:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791527424:0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309548:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788725981.309560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725981.309571:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791526272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309613:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526912 00000100:00100000:3.0:1788725981.309615:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791526272:12345-0@lo:400:kworker.0 Request processed in 59us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725981.309618:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526912 00000100:00100000:3.0:1788725981.309625:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788725981.309641:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788725981.309648:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309649:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527424 00000100:00100000:1.0:1788725981.309654:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527424 00000100:00100000:1.0:1788725981.309674:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788725981.309681:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791526912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309688:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791526016:12345-0@lo:400:kworker.0 Request processed in 39us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309696:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788725981.309712:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788725981.309720:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791526912:12345-0@lo:400:kworker.0 Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309721:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791526528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309732:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788725981.309746:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788725981.309754:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791527424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725981.309763:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875614791526528:12345-0@lo:400:kworker.0 Request processed in 44us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309769:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788725981.309789:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788725981.309790:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791527424:12345-0@lo:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309798:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791527040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309800:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788725981.309830:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791525888 00000100:00100000:1.0:1788725981.309834:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791525888 00000100:00100000:3.0:1788725981.309835:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791527040:12345-0@lo:400:kworker.0 Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725981.309843:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788725981.309865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788725981.309875:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.309909:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791525888:12345-0@lo:400:kworker.0 Request processed in 37us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725981.309916:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788725981.309961:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791527552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788725981.309985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725981.310016:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791525888:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.310027:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791526912:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.310035:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791527424:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.310042:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791526016:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.310051:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1875614791526528:0@lo:400:kworker.0 00000100:00100000:1.0:1788725981.310059:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791527040:0@lo:400:kworker.0 00000100:00080000:0.0:1788725981.310248:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788725981.310252:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725981.310255:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788725981.310257:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725981.310266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791526400 00000100:00100000:0.0:1788725981.310270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791526400 00000100:00100000:0.0:1788725981.310305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788725981.310312:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791526400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725981.310351:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791526400:12345-0@lo:400:kworker.0 Request processed in 40us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725981.310357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788725981.310378:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791526400:0@lo:400:kworker.0 00000100:00100000:0.0:1788725981.310484:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788725981.310564:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791526272:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.310575:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791526784:0@lo:400:kworker.0 00000100:00100000:2.0:1788725981.310584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791527296:0@lo:400:kworker.0 00010000:00080000:2.0:1788725981.310607:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283e30380 x1875614791526656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725981.310618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791526656:0@lo:400:kworker.0 00010000:00080000:2.0:1788725981.310629:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13812aa680 x1875614791527168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788725997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725981.310637:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13812aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791527168:0@lo:400:kworker.0 00000100:00100000:0.0:1788725981.310878:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791527680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725981.310917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725981.316285:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527552 00000100:00100000:2.0:1788725981.316300:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527552 00000100:00100000:2.0:1788725981.316365:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527680 00000100:00100000:2.0:1788725981.316369:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527680 00000100:00100000:2.0:1788725981.316389:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788725981.316398:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791527552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725981.316429:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725981.316516:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791527552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (6528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725981.316523:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788725981.316541:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788725981.316547:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791527680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788725981.316558:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725981.316591:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791527680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (5673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725981.316597:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788725981.316881:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791527680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788725981.316926:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791527552:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788725982.081293:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725982.331852:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791527808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725982.331939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725982.332064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527808 00000100:00100000:3.0:1788725982.332072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527808 00000100:00100000:3.0:1788725982.332141:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788725982.332152:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791527808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788725982.332183:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788725982.332246:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791527808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725982.332254:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788725982.332337:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791527808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788725982.893289:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725982.893392:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770510080 00000100:00100000:2.0:1788725982.893402:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770510080 00000100:00100000:2.0:1788725982.893472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00100000:2.0:1788725982.893498:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+18:13176:x1875614770510080:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788725982.893774:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:13176:x1875614770510080:12345-192.168.203.12@tcp:35:umount.0 Request processed in 278us (493us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788725982.893782:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 66 00000100:00080000:0.0:1788725982.893986:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788725982.901308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725982.903097:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770510336 00000100:00100000:2.0:1788725982.903110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770510336 00000100:00100000:2.0:1788725982.903229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:2.0:1788725982.903240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+19:13176:x1875614770510336:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:2.0:1788725982.904225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:78ae299a-14d0-4856-aa24-442bf24804dd+20:13176:x1875614770510336:12345-192.168.203.12@tcp:35:umount.0 Request processed in 981us (2921us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788725982.904235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 67 00000100:00100000:1.0:1788725982.910802:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725982.910941:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770510592 00000100:00100000:3.0:1788725982.910950:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770510592 00000100:00100000:3.0:1788725982.911012:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:3.0:1788725982.911023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13864c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+20:13176:x1875614770510592:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:3.0:1788725982.911289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13864c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+21:13176:x1875614770510592:12345-192.168.203.12@tcp:35:umount.0 Request processed in 268us (496us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788725982.911307:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 68 00000100:00100000:0.0:1788725982.917553:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788725982.917637:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770510848 00000100:00100000:3.0:1788725982.917647:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770510848 00000100:00100000:3.0:1788725982.917702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:3.0:1788725982.917714:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+21:13176:x1875614770510848:12345-192.168.203.12@tcp:35:umount.0 00000100:00100000:3.0:1788725982.918452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:78ae299a-14d0-4856-aa24-442bf24804dd+22:13176:x1875614770510848:12345-192.168.203.12@tcp:35:umount.0 Request processed in 736us (907us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788725982.918462:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 69 00000100:00100000:0.0:1788725982.926717:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725982.926768:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725982.926789:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770510976 00000100:00100000:2.0:1788725982.926799:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770510976 00000100:00100000:3.0:1788725982.926830:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770511104 00000100:00100000:3.0:1788725982.926837:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770511104 00000100:00100000:2.0:1788725982.926872:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788725982.926884:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+14:2398:x1875614770510976:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725982.926900:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725982.926920:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae800/0xa13c582691d36e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc2 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725982.926936:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725982.926941:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725982.926989:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770510976:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725982.926997:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788725982.929152:0:10330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770511616 00000100:00100000:3.0:1788725982.929164:0:10330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770511616 00000100:00100000:2.0:1788725982.929200:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788725982.929223:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2398:x1875614770511104:12345-192.168.203.12@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788725982.929228:0:10330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788725982.929241:0:10330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+13:2395:x1875614770511616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788725982.929252:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788725982.929254:0:10330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788725982.929274:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ea00/0xa13c582691d36e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6c83 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725982.929275:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949e800/0xa13c582691d370e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d9b expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788725982.929304:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788725982.929307:0:10330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788725982.929348:0:10330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b74862ab-5cca-4993-81bc-e5d26377a66b+11:2395:x1875614770511616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 110us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725982.929355:0:10330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:2.0:1788725982.929405:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770511104:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 184us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725982.929413:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788725982.932283:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725982.934041:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770511488 00000100:00100000:1.0:1788725982.934250:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770511488 00000100:00100000:1.0:1788725982.934322:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:1.0:1788725982.934333:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+7:2394:x1875614770511488:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:1.0:1788725982.934365:0:8716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d37460 00000020:00010000:1.0:1788725982.934372:0:8716:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b1385531000: total 0 00000100:00080000:1.0:1788725982.934377:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b1385536800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788725982.934429:0:8716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:0.0:1788725982.934642:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788725982.934708:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770511488:12345-192.168.203.12@tcp:9:umount.0 Request processed in 376us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725982.934716:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000020:00010000:3.0:1788725982.934840:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b1385531000: total 0 00010000:00010000:3.0:1788725982.934879:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b1385531000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788725982.934927:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046059cad/0xa13c582691d37818 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f85 expref: 4 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725982.934960:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3c8ccb1/0xa13c582691d37ee7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7168 expref: 3 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725982.934975:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b1385531000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788725982.934987:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725982.934989:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725982.934991:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725982.941385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725982.941957:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770511744 00000100:00100000:0.0:1788725982.941966:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770511744 00000100:00100000:0.0:1788725982.942081:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:0.0:1788725982.942092:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770511744:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:0.0:1788725982.942143:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d371ea 00000100:00080000:0.0:1788725982.942152:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b13874ef800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788725982.942222:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788725982.942384:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:78ae299a-14d0-4856-aa24-442bf24804dd+2:2394:x1875614770511744:12345-192.168.203.12@tcp:9:umount.0 Request processed in 293us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725982.942392:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00080000:2.0:1788725982.942520:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788725982.942745:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725982.956542:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725982.956638:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770512768 00000100:00100000:1.0:1788725982.956646:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770512768 00000100:00100000:1.0:1788725982.956703:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 258 00000100:00100000:1.0:1788725982.956728:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+22:2394:x1875614770512768:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:1.0:1788725982.956768:0:9522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36e1d 00000020:00010000:1.0:1788725982.956784:0:9522:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b139e738800: total 0 00000100:00080000:1.0:1788725982.956789:0:9522:0:(import.c:65:import_set_state_nolock()) ffff9b139e73b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788725982.956829:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788725982.956987:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:78ae299a-14d0-4856-aa24-442bf24804dd+21:2394:x1875614770512768:12345-192.168.203.12@tcp:39:umount.0 Request processed in 262us (455us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788725982.956996:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 258 00000020:00010000:0.0:1788725982.958342:0:7452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b139e738800: total 0 00010000:00010000:0.0:1788725982.958410:0:7452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b139e738800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788725982.958446:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725982.958450:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725982.958458:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d37ea8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7153 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958474:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725982.958476:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788725982.958480:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d37ed2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7161 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958491:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725982.958494:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788725982.958497:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af200/0xa13c582691d371c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6dc5 expref: 18 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958508:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725982.958511:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788725982.958514:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2044a00/0xa13c582691d37b8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7081 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958527:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:0.0:1788725982.958530:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725982.958533:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b200/0xa13c582691d37881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa1 expref: 16 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958547:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725982.958550:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788725982.958566:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7400/0xa13c582691d377d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f70 expref: 15 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958581:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725982.958583:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788725982.958586:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a9600/0xa13c582691d37803 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f7e expref: 14 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958597:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9b1382afe700) 00010000:00010000:0.0:1788725982.958599:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788725982.958603:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8600/0xa13c582691d374bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6e9e expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958620:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b1394485800) 00010000:00010000:0.0:1788725982.958623:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788725982.958627:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b139e6af400/0xa13c582691d37165 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6db0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958641:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9b1394485f00) 00010000:00010000:0.0:1788725982.958643:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725982.958647:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045a00/0xa13c582691d37dc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a711b expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958660:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9b1283234a00) 00010000:00010000:0.0:1788725982.958662:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788725982.958666:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13af8a8200/0xa13c582691d3789d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6fa8 expref: 10 pid: 9522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958680:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9b1283455800) 00010000:00010000:0.0:1788725982.958687:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788725982.958692:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2045200/0xa13c582691d376f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6f38 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958708:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283237c00) 00010000:00010000:0.0:1788725982.958710:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788725982.958714:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d37149 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6da9 expref: 8 pid: 11950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725982.958727:0:7452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b139e738800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788725982.958754:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725982.958756:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725982.958758:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725982.970549:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725982.970653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770512896 00000100:00100000:0.0:1788725982.970662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770512896 00000100:00100000:0.0:1788725982.970738:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 259 00000100:00100000:0.0:1788725982.970750:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+5:2394:x1875614770512896:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:0.0:1788725982.970784:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36e24 00000100:00080000:0.0:1788725982.970800:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9b139e73e800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788725982.971049:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:0.0:1788725982.971109:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788725982.971309:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:78ae299a-14d0-4856-aa24-442bf24804dd+3:2394:x1875614770512896:12345-192.168.203.12@tcp:39:umount.0 Request processed in 560us (768us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788725982.971317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 259 00010000:00010000:3.0:1788725982.971866:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788725983.101957:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725983.867616:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725983.867640:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791527936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788725983.867711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725983.867905:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791527936 00000100:00100000:2.0:1788725983.867913:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791527936 00000100:00100000:2.0:1788725983.867971:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788725983.867981:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791527936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788725983.868015:0:7833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788725983.868074:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791527936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725983.868082:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788725983.868473:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791527936:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788725984.128149:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725984.379353:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791528064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788725984.379407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725984.379476:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791528192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725984.379492:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725984.379551:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528064 00000100:00100000:3.0:1788725984.379558:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528064 00000100:00100000:3.0:1788725984.379615:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528192 00000100:00100000:3.0:1788725984.379618:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528192 00000100:00100000:3.0:1788725984.379655:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788725984.379663:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791528064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788725984.379691:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725984.379738:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791528064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725984.379745:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788725984.379760:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788725984.379764:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791528192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788725984.379772:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788725984.379792:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791528192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725984.379795:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788725984.379825:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791528064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788725984.379842:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791528192:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788725984.379897:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725984.447236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725984.447386:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725984.447430:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725984.447554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513280 00000100:00100000:0.0:1788725984.447566:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513280 00000100:00100000:0.0:1788725984.447663:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513152 00000100:00100000:0.0:1788725984.447667:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513152 00000100:00100000:0.0:1788725984.447694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 357 00000100:00100000:0.0:1788725984.447722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770513280:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725984.447820:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+5:2398:x1875614770513280:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 100us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725984.447829:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 357 00000100:00100000:0.0:1788725984.447850:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 358 00000100:00100000:0.0:1788725984.447857:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2398:x1875614770513152:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788725984.447883:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed75931d-dab3-4684-a02c-ea7022155724+6:2398:x1875614770513152:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725984.447890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 358 00000100:00080000:2.0:1788725984.448153:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788725984.448159:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788725984.451753:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513024 00000100:00100000:1.0:1788725984.451774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513024 00000100:00100000:1.0:1788725984.451869:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 396 00000100:00100000:1.0:1788725984.451884:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770513024:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788725984.453898:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770513024:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 2000us (6658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725984.453942:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 396 00000100:00100000:2.0:1788725984.994699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725984.994749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725984.995088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725985.002646:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513536 00000100:00100000:0.0:1788725985.002660:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513536 00000100:00100000:1.0:1788725985.002822:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513408 00000100:00100000:1.0:1788725985.002828:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513408 00000100:00100000:1.0:1788725985.002906:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513664 00000100:00100000:1.0:1788725985.002910:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513664 00000100:00100000:1.0:1788725985.002936:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788725985.002946:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+12:2398:x1875614770513536:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725985.002961:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725985.002980:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659400/0xa13c582691d36f27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d08 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725985.003001:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725985.003060:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+11:2398:x1875614770513536:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 115us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725985.003067:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788725985.003086:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788725985.003093:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+10:2398:x1875614770513408:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725985.003101:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725985.003111:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030200/0xa13c582691d36f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cd7 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725985.003149:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725985.003169:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+9:2398:x1875614770513408:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 76us (8419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725985.003175:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788725985.003221:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:1.0:1788725985.003245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab292450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+8:2397:x1875614770513664:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788725985.003254:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725985.003265:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383658000/0xa13c582691d370e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6d94 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725985.003274:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725985.003296:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab292450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b74862ab-5cca-4993-81bc-e5d26377a66b+7:2397:x1875614770513664:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 53us (8208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725985.003302:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788725985.004666:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788725985.004766:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770513920 00000100:00100000:0.0:1788725985.005059:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770513920 00000100:00100000:0.0:1788725985.005153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 260 00000100:00100000:0.0:1788725985.005163:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+6:2394:x1875614770513920:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:0.0:1788725985.005213:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36f3c 00000020:00010000:0.0:1788725985.005222:0:6511:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b139f7b6000: total 0 00000100:00080000:0.0:1788725985.005227:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9b139f7b5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788725985.005246:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788725985.005399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed75931d-dab3-4684-a02c-ea7022155724+5:2394:x1875614770513920:12345-192.168.203.12@tcp:39:umount.0 Request processed in 238us (738us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788725985.005408:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 260 00000020:00010000:3.0:1788725985.009784:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b139f7b6000: total 0 00010000:00010000:3.0:1788725985.009793:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725985.009855:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b139f7b6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788725985.009905:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283234d00) 00010000:00010000:3.0:1788725985.009909:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788725985.009920:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d37ef5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a716f expref: 4 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725985.009947:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b139f7b6000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788725985.009969:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725985.009972:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725985.009974:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725985.016896:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788725985.016996:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514048 00000100:00100000:1.0:1788725985.017015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514048 00000100:00100000:1.0:1788725985.017071:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 261 00000100:00100000:1.0:1788725985.017082:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+5:2394:x1875614770514048:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:1.0:1788725985.017150:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36f35 00000100:00080000:1.0:1788725985.017161:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9b12835e0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788725985.017196:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788725985.017364:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed75931d-dab3-4684-a02c-ea7022155724+3:2394:x1875614770514048:12345-192.168.203.12@tcp:39:umount.0 Request processed in 282us (485us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788725985.017372:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 261 00010000:00010000:2.0:1788725985.017632:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725985.041434:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788725985.041544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514304 00000100:00100000:2.0:1788725985.041555:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514304 00000100:00100000:2.0:1788725985.041615:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 397 00000100:00100000:2.0:1788725985.041625:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+7:2394:x1875614770514304:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:2.0:1788725985.041666:0:6504:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36dfa 00000020:00010000:2.0:1788725985.041673:0:6504:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b12834b3000: total 0 00000100:00080000:2.0:1788725985.041677:0:6504:0:(import.c:65:import_set_state_nolock()) ffff9b12834b4800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788725985.041744:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b74862ab-5cca-4993-81bc-e5d26377a66b+3:2394:x1875614770514304:12345-192.168.203.12@tcp:251:umount.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725985.041751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 397 00000020:00010000:0.0:1788725985.041864:0:7452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b12834b3000: total 0 00010000:00010000:0.0:1788725985.041933:0:7452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b12834b3000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788725985.041972:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178600/0xa13c582691d36e55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a6cc9 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725985.042000:0:7452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b12834b3000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788725985.042020:0:7452:0:(genops.c:885:class_export_put()) final put ffff9b12834b3000/b74862ab-5cca-4993-81bc-e5d26377a66b 00010000:00010000:0.0:1788725985.042034:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725985.042036:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725985.042038:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788725985.042243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12834b3000/b74862ab-5cca-4993-81bc-e5d26377a66b for MGS 00000020:00000080:2.0:1788725985.042274:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12834b4800 for MGS 00000040:00080000:2.0:1788725985.083492:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788725985.083501:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788725985.083602:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788725985.083610:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788725985.147457:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788725985.859624:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788725986.173056:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725986.427543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788725986.427611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725986.427702:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528320 00000100:00100000:3.0:1788725986.427717:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528320 00000100:00100000:3.0:1788725986.427769:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788725986.427778:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791528320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788725986.427806:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788725986.427850:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791528320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725986.427857:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788725986.427901:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791528320:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788725986.428082:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725986.428091:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725986.428101:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791528448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788725986.428155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725986.428201:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528448 00000100:00100000:2.0:1788725986.428205:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528448 00000100:00100000:2.0:1788725986.428236:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788725986.428243:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791528448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725986.428254:0:8428:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725986.428284:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791528448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725986.428300:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788725986.428315:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788725986.428337:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791528448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788725986.435738:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788725986.435825:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725986.435849:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791528960:0@lo:400:kworker.0 00000100:00100000:2.0:1788725986.435917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725986.435977:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528960 00000100:00100000:2.0:1788725986.435984:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528960 00000100:00100000:2.0:1788725986.436034:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788725986.436043:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725986.436093:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791528960:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725986.436099:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788725986.436160:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791528960:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.439194:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791528704:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.439262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.439317:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725986.439325:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.439351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.439384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528704 00000100:00100000:3.0:1788725986.439500:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791528576:0@lo:400:kworker.0 00000100:00100000:3.0:1788725986.439534:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725986.439570:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528576 00000100:00100000:3.0:1788725986.439575:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528576 00000100:00100000:3.0:1788725986.439616:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788725986.439626:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791528576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725986.439684:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3640:x1875614791528576:12345-0@lo:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725986.439691:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788725986.439748:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3640:1875614791528576:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.439861:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528704 00000100:00100000:0.0:1788725986.439906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788725986.439914:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791528704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.439957:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791528704:12345-0@lo:400:kworker.0 Request processed in 45us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.439963:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788725986.439986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791528832 00000100:00100000:0.0:1788725986.439990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791528832 00000100:00100000:0.0:1788725986.440014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788725986.440020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.440054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791528832:12345-0@lo:400:kworker.0 Request processed in 34us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.440060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788725986.440088:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.440109:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791528704:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.440332:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791529088:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.440363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.440432:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788725986.440439:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791529472:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.440462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.440495:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791529600:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.440527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.440556:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529472 00000100:00100000:1.0:1788725986.440560:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529472 00000100:00100000:1.0:1788725986.440591:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529600 00000100:00100000:1.0:1788725986.440595:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529600 00000100:00100000:1.0:1788725986.440617:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788725986.440624:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791529472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.440655:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791529472:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725986.440660:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788725986.440684:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788725986.440690:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.440918:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791529344:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.440948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.440968:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725986.440974:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791529216:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.440994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.441018:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529344 00000100:00100000:0.0:1788725986.441022:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529344 00000100:00100000:0.0:1788725986.441047:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529216 00000100:00100000:0.0:1788725986.441050:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529216 00000100:00100000:0.0:1788725986.441069:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788725986.441076:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791529344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.441110:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791529344:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.441142:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788725986.441157:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788725986.441164:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.441206:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791529216:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.441212:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788725986.441252:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791529216:0@lo:400:kworker.0 00010000:00080000:0.0:1788725986.441264:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128375ad80 x1875614791529344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788725986.441273:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791529344:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.441369:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791529600:12345-0@lo:400:kworker.0 Request processed in 678us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725986.441375:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788725986.441461:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788725986.441465:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788725986.441467:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725986.441491:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791529600:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.441501:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791529472:0@lo:400:kworker.0 00000100:00100000:3.0:1788725986.441617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529088 00000100:00100000:3.0:1788725986.441621:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529088 00000100:00100000:3.0:1788725986.441655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788725986.441680:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791529088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725986.441851:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791529088:12345-0@lo:400:kworker.0 Request processed in 182us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725986.441858:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788725986.441894:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791529088:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.442007:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791529728:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.442038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.442108:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788725986.442232:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791529856:0@lo:400:kworker.0 00000100:00100000:0.0:1788725986.442259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.449597:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529728 00000100:00100000:1.0:1788725986.449613:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529728 00000100:00100000:1.0:1788725986.449840:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529856 00000100:00100000:1.0:1788725986.449845:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529856 00000100:00100000:1.0:1788725986.449880:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788725986.449890:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791529728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.449979:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791529728:12345-0@lo:400:kworker.0 Request processed in 91us (7940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725986.449999:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788725986.450016:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788725986.450022:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.450055:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791529856:12345-0@lo:400:kworker.0 Request processed in 33us (7795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725986.450061:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00080000:1.0:1788725986.450158:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128375a300 x1875614791529856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725986.450174:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791529856:0@lo:400:kworker.0 00000100:00100000:1.0:1788725986.450199:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791529728:0@lo:400:kworker.0 00000100:00080000:0.0:1788725986.450329:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725986.450334:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:2.0:1788725986.720937:0:15145:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788725986.743843:0:15145:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788725986.743900:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.743915:0:15145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.743923:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.743931:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.743956:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788725986.743962:0:15145:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788725986.743989:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788725986.743993:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788725986.744000:0:15145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788725986.744026:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b13842bb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788725986.744060:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791529984:0@lo:39:umount.0 00000100:00100000:3.0:1788725986.744149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725986.744223:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791529984 00000100:00100000:3.0:1788725986.744231:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791529984 00000100:00100000:3.0:1788725986.744278:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788725986.744287:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875614791529984:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788725986.744313:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a11 00000100:00080000:3.0:1788725986.744321:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9b13b4b92800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788725986.744378:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1875614791529984:12345-0@lo:39:umount.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725986.744385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788725986.744393:0:6510:0:(genops.c:885:class_export_put()) final put ffff9b13842df800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788725986.744413:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725986.744419:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.744427:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725986.744431:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.744439:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725986.744447:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725986.744453:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788725986.744455:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788725986.744458:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788725986.744482:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.744488:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725986.744506:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.744519:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d36eb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36eb7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.744531:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.744533:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.744535:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725986.744542:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725986.744553:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725986.744582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788725986.744625:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788725986.744631:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791529984:0@lo:39:umount.0 00000100:00080000:3.0:1788725986.744652:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788725986.744654:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788725986.744658:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788725986.745512:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745525:0:15145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745532:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745539:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745563:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788725986.745578:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745585:0:15145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745591:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745597:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745607:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788725986.745621:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788725986.745625:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745632:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ae00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725986.745635:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745643:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725986.745649:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725986.745655:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788725986.745657:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788725986.745678:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745693:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725986.745707:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745713:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148ae00/0xa13c582691d36ebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ec5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745725:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725986.745728:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745734:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725986.745737:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745743:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725986.745749:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725986.745755:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788725986.745757:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788725986.745759:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788725986.745774:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745781:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725986.745797:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745814:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179400/0xa13c582691d36db4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36dbb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745824:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.745826:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.745828:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725986.745846:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725986.745886:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788725986.745926:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745935:0:15145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745941:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745948:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745960:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788725986.745967:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725986.745971:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745977:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383659c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725986.745980:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.745998:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725986.746005:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725986.746010:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788725986.746012:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788725986.746014:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788725986.746030:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746036:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725986.746043:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746049:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383659c00/0xa13c582691d37118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d3711f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746060:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.746062:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.746063:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.746074:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746081:0:15145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746087:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746104:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746144:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788725986.746149:0:15145:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788725986.746153:0:15145:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788725986.746189:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788725986.746193:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746200:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fa00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788725986.746203:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746210:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788725986.746217:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788725986.746222:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788725986.746225:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788725986.746226:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788725986.746241:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746247:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788725986.746257:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746273:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949fa00/0xa13c582691d36970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36977 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788725986.746283:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.746284:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725986.746286:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725986.746294:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788725986.746302:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725986.746327:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788725986.746357:0:15145:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788725986.746361:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788725986.746365:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725986.746370:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/15 00000020:00080000:3.0:1788725986.746375:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b1282105800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788725986.746380:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b139f765800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788725986.746385:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b1385553800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788725986.746389:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b13abd38000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788725986.746396:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b139f7b6000 ed75931d-dab3-4684-a02c-ea7022155724 192.168.203.12@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788725986.746402:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9b139e738800 78ae299a-14d0-4856-aa24-442bf24804dd 192.168.203.12@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788725986.746406:0:15145:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b1384b54d28) has exports, disconnecting them 00000020:00080000:3.0:1788725986.746410:0:15145:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b1282105800), last request at 1788725986 00000020:00000080:3.0:1788725986.746417:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d21 00000100:00080000:3.0:1788725986.746430:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b1282103000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788725986.746463:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788725986.746474:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b1282105800): rc 0 00000020:00000080:3.0:1788725986.746482:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1282105800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788725986.746488:0:15145:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b139f765800), last request at 1788725986 00000020:00000080:3.0:1788725986.746492:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c09 00000100:00080000:3.0:1788725986.746497:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b139f766000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788725986.746507:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788725986.746514:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b139f765800): rc 0 00000020:00000080:3.0:1788725986.746516:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b139f765800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788725986.746520:0:15145:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b1385553800), last request at 1788725753 00000020:00000080:3.0:1788725986.746522:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36af8 00000100:00080000:3.0:1788725986.746526:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b1385554800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788725986.746533:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788725986.746539:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b1385553800): rc 0 00000020:00000080:3.0:1788725986.746541:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1385553800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788725986.746545:0:15145:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b13abd38000), last request at 1788725753 00000020:00000080:3.0:1788725986.746548:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36ab9 00000100:00080000:3.0:1788725986.746551:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b13abd3e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788725986.746558:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788725986.746565:0:15145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788725986.746629:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b13abd38000): rc 0 00000004:00000080:3.0:1788725986.746635:0:15145:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf82417b7ae0 00000100:00080000:3.0:1788725986.746652:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788725986.746655:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788725986.747318:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725986.747413:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530112 00000100:00100000:2.0:1788725986.747422:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530112 00010000:00010000:0.0:1788725986.747437:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725986.747451:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530240 00000100:00100000:0.0:1788725986.747455:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530240 00000100:00100000:2.0:1788725986.747471:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530624 00000100:00100000:2.0:1788725986.747474:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530624 00000100:00100000:0.0:1788725986.747478:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788725986.747486:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788725986.747487:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3641:x1875614791530112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725986.747491:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+26:3641:x1875614791530240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788725986.747499:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725986.747499:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1788725986.748018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842df800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788725986.748068:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282105800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788725986.748092:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f765800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788725986.748113:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1385553800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788725986.748167:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13b4b92800 for lustre-MDT0000 00000020:00000080:1.0:1788725986.748172:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1282103000 for lustre-MDT0000 00000020:00000080:1.0:1788725986.748186:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f766000 for lustre-MDT0000 00000020:00000080:1.0:1788725986.748190:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1385554800 for lustre-MDT0000 00000100:00100000:1.0:1788725986.748209:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791530368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725986.748259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.748291:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788725986.748297:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791530496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788725986.748317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788725986.748425:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030a00/0xa13c582691d36ec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36ebe expref: 26 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788725986.748532:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788725986.748552:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788725986.748794:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6aee00/0xa13c582691d36eb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36eb0 expref: 25 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725986.748808:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725986.748850:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791530112:12345-0@lo:103:ldlm_bl.0 Request processed in 1364us (4267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.748858:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788725986.748875:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530368 00000100:00100000:0.0:1788725986.748880:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530368 00000100:00100000:0.0:1788725986.748903:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530496 00000100:00100000:0.0:1788725986.748905:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530496 00000100:00100000:0.0:1788725986.748920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725986.748929:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+25:3641:x1875614791530624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788725986.748936:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725986.748946:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b138148a000/0xa13c582691d36977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36970 expref: 25 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725986.748962:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725986.748985:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+24:3641:x1875614791530624:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.748991:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788725986.749003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788725986.749009:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+23:3638:x1875614791530368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788725986.749016:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788725986.749024:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179800/0xa13c582691d36dbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36db4 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725986.749033:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788725986.749059:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07aa06c1-b26f-4687-bdcf-2948685dbe8f+22:3638:x1875614791530368:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725986.749064:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788725986.749074:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788725986.749080:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07aa06c1-b26f-4687-bdcf-2948685dbe8f+21:3638:x1875614791530496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788725986.749089:0:15146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788725986.749097:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659e00/0xa13c582691d3711f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d37118 expref: 21 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725986.749159:0:15146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788725986.749199:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:07aa06c1-b26f-4687-bdcf-2948685dbe8f+20:3638:x1875614791530496:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (881us total) trans 0 rc 0/0 00000100:00080000:3.0:1788725986.749369:0:15145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788725986.749390:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b139e4fa000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788725986.749422:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791530752:0@lo:39:umount.0 00000100:00100000:3.0:1788725986.749453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725986.750490:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725986.750503:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725986.750534:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791530496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725986.750541:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3638:1875614791530368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788725986.750560:0:7833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530752 00000100:00100000:0.0:1788725986.750566:0:7833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530752 00000100:00100000:0.0:1788725986.750896:0:7833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788725986.750906:0:7833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875614791530752:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788725986.751032:0:7833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36b53 00000100:00080000:0.0:1788725986.751040:0:7833:0:(import.c:65:import_set_state_nolock()) ffff9b139e52f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788725986.751071:0:7833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788725986.751240:0:7833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3637:x1875614791530752:12345-0@lo:39:umount.0 Request processed in 335us (1785us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788725986.751248:0:7833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:0.0:1788725986.751274:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788725986.751295:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139e4fa000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788725986.751301:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791530752:0@lo:39:umount.0 00000100:00100000:1.0:1788725986.752209:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788725986.754262:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788725986.754269:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788725986.754307:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788725986.754364:0:15145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788725986.754387:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b1282215000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788725986.754405:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788725986.754408:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788725986.754417:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788725986.754484:0:15145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788725986.754494:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b1283543800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788725986.754521:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b1384b54d28) has no exports 00010000:00010000:2.0:1788725986.756552:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788725986.756651:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3641:x1875614791530240:12345-0@lo:103:ldlm_bl.0 Request processed in 9154us (10759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725986.756662:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788725986.759546:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791530880:0@lo:9:umount.0 00000100:00100000:1.0:1788725986.759647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.759692:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791531008:0@lo:9:umount.0 00000100:00100000:1.0:1788725986.759715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725986.759758:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791530880 00000100:00100000:1.0:1788725986.759765:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791530880 00000100:00100000:1.0:1788725986.760026:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531008 00000100:00100000:1.0:1788725986.760031:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531008 00000100:00100000:1.0:1788725986.760055:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788725986.760081:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875614791530880:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788725986.760111:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36ca3 00000100:00080000:1.0:1788725986.760157:0:8426:0:(import.c:65:import_set_state_nolock()) ffff9b1281a39000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788725986.760207:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000001:00000004:1.0:1788725986.760211:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788725986.760221:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875614791531008:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788725986.760249:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36de5 00000100:00080000:3.0:1788725986.760255:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b139e601800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788725986.760273:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788725986.760297:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788725986.760366:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3637:x1875614791530880:12345-0@lo:9:umount.0 Request processed in 286us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725986.760374:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788725986.760398:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3637:x1875614791531008:12345-0@lo:9:umount.0 Request processed in 180us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725986.760407:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788725986.760497:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282215000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788725986.760530:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788725986.760533:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788725986.760537:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791530880:0@lo:9:umount.0 00000100:00080000:1.0:1788725986.760553:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1283543800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788725986.760682:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788725986.760685:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788725986.760690:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791531008:0@lo:9:umount.0 00010000:00010000:0.0:1788725986.761094:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725986.762007:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791530240:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788725986.773559:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b1384b54d28) has no exports 00000020:00000080:1.0:1788725986.825949:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d369cb 00000020:00000080:1.0:1788725986.825966:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842df000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788725986.825989:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788725986.826193:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842df000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788725986.826222:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725986.826232:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788725986.826236:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b13bd49b370) has no exports 00000020:00000080:0.0:1788725986.826536:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d369c4 00000020:00000080:0.0:1788725986.826543:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b138428a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788725986.826606:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725986.826613:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788725986.826615:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1384289800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788725986.826618:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1384289800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788725986.826622:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788725986.827482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b138428a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788725987.195425:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725988.219395:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725988.989440:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791531136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788725988.989583:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725988.989695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531136 00000100:00100000:0.0:1788725988.989704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531136 00000100:00100000:0.0:1788725988.989762:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788725988.989771:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875614791531136:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788725988.989780:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788725988.989841:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875614791531136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (257us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788725988.989848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:02020000:2.0:1788725988.989915:0:3641:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:0.0:1788725988.994746:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788725988.994755:0:8420:0:(genops.c:885:class_export_put()) final put ffff9b1281a3d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788725988.994768:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:0.0:1788725988.994770:0:8420:0:(genops.c:885:class_export_put()) final put ffff9b13874ec000/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:1.0:1788725988.994902:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a3d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788725988.995445:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13874ec000/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-OST0000 00000020:00000080:1.0:1788725988.995461:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1281a39000 for lustre-OST0000 00000020:00000080:1.0:1788725988.995467:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13874ef800 for lustre-OST0000 00000001:00100000:1.0:1788725988.995975:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788725988.995980:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b139e600000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788725988.995996:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:1.0:1788725988.995998:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b1385531000/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:0.0:1788725988.996048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e600000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788725988.996148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1385531000/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-OST0001 00000020:00000080:0.0:1788725988.996185:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e601800 for lustre-OST0001 00000020:00000080:0.0:1788725988.996189:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1385536800 for lustre-OST0001 00000100:00080000:2.0:1788725988.996273:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788725988.996279:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788725988.996283:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788725989.004679:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788725989.004691:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:2.0:1788725989.004707:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b13abd4a800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788725989.004807:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283e32300 x1875614791531264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788725989.007279:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791531264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788725989.007346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725989.007470:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531264 00000100:00100000:0.0:1788725989.007477:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531264 00000100:00100000:0.0:1788725989.007522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788725989.007529:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791531264:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788725989.007547:0:6515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788725989.013283:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788725989.013297:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788725989.013302:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791531264:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788725989.013678:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791531264:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 6145us (6327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788725989.013688:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000001:00100000:2.0:1788725989.014184:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788725989.014186:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788725989.014190:0:6490:0:(genops.c:885:class_export_put()) final put ffff9b13abd38000/lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1788725989.014195:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788725989.014198:0:7442:0:(genops.c:885:class_export_put()) final put ffff9b139e52b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788725989.014261:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000001:00080000:0.0:1788725989.014267:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788725989.014269:0:6490:0:(genops.c:885:class_export_put()) final put ffff9b139f7b6000/ed75931d-dab3-4684-a02c-ea7022155724 00000001:00100000:0.0:1788725989.020037:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000001:00080000:0.0:1788725989.020050:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788725989.020063:0:6490:0:(genops.c:885:class_export_put()) final put ffff9b139e738800/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:3.0:1788725989.020244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd38000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788725989.020299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e52b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:2.0:1788725989.020311:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ed75931d-dab3-4684-a02c-ea7022155724 00000001:00080000:2.0:1788725989.020318:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788725989.020320:0:7442:0:(genops.c:885:class_export_put()) final put ffff9b12835e7800/ed75931d-dab3-4684-a02c-ea7022155724 00000001:00100000:2.0:1788725989.020325:0:7442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:3.0:1788725989.020331:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f7b6000/ed75931d-dab3-4684-a02c-ea7022155724 for lustre-MDT0000 00000001:00080000:2.0:1788725989.020331:0:7442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788725989.020333:0:7442:0:(genops.c:885:class_export_put()) final put ffff9b139e73c000/78ae299a-14d0-4856-aa24-442bf24804dd 00000020:00000080:3.0:1788725989.020351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e738800/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-MDT0000 00000020:00000080:3.0:1788725989.020378:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13abd3e800 for lustre-MDT0000 00000020:00000080:3.0:1788725989.020385:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e52f800 for lustre-MDT0001 00000020:00000080:3.0:1788725989.020389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12835e7800/ed75931d-dab3-4684-a02c-ea7022155724 for lustre-MDT0001 00000020:00000080:3.0:1788725989.020421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e73c000/78ae299a-14d0-4856-aa24-442bf24804dd for lustre-MDT0001 00000020:00000080:3.0:1788725989.020452:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f7b5800 for lustre-MDT0000 00000020:00000080:3.0:1788725989.020456:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e73b000 for lustre-MDT0000 00000020:00000080:3.0:1788725989.020476:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12835e0800 for lustre-MDT0001 00000020:00000080:3.0:1788725989.020479:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e73e800 for lustre-MDT0001 00010000:00010000:0.0:1788725989.243316:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725989.499448:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788725989.499472:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791531392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788725989.499538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725989.506757:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531392 00000100:00100000:2.0:1788725989.506772:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531392 00000100:00100000:2.0:1788725989.506862:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788725989.506873:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791531392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788725989.506995:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788725989.507081:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791531392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 210us (7542us total) trans 0 rc 0/0 00000100:00080000:0.0:1788725989.507752:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788725989.507826:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788725989.509054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791531392:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788725990.270375:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725991.292596:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788725991.547451:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791531520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788725991.547521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725991.547640:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531520 00000100:00100000:2.0:1788725991.547647:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531520 00000100:00100000:2.0:1788725991.547719:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788725991.547730:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791531520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788725991.547757:0:8429:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788725991.547814:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791531520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725991.547820:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788725991.547935:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788725991.547988:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791531520:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788725991.548183:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788725991.548187:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788725991.548190:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788725991.548195:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1788725991.548199:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788725991.548204:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b13abd4a800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725991.548224:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346df80 x1875614791531776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725991.548226:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725991.548242:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791531648:0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.548283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725991.548287:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791532032:0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.548318:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791531904:0@lo:400:kworker.0 00000100:00100000:3.0:1788725991.548325:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725991.548352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725991.548367:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531648 00000100:00100000:3.0:1788725991.548372:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531648 00000100:00100000:3.0:1788725991.548405:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788725991.548415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3641:x1875614791531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788725991.548457:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13848cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07aa06c1-b26f-4687-bdcf-2948685dbe8f+19:3641:x1875614791531648:12345-0@lo:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725991.548462:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791532416:0@lo:400:kworker.0 00000100:00100000:3.0:1788725991.548468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788725991.548495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725991.548508:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791532544:0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.548523:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791531648:0@lo:400:kworker.0 00000100:00100000:3.0:1788725991.548538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725991.548540:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788725991.548547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791532288:0@lo:400:kworker.0 00000100:00100000:3.0:1788725991.548563:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788725991.548572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791532160:0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.548578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725991.548616:0:8716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532288 00000100:00100000:2.0:1788725991.548620:0:8716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532288 00000100:00100000:2.0:1788725991.548651:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788725991.548658:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791532288:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788725991.548723:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788725991.548744:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532032 00000100:00100000:0.0:1788725991.548747:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532032 00000100:00100000:0.0:1788725991.548769:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531904 00000100:00100000:0.0:1788725991.548772:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531904 00000100:00100000:0.0:1788725991.548779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532416 00000100:00100000:0.0:1788725991.548781:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532416 00000100:00100000:0.0:1788725991.548788:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532544 00000100:00100000:0.0:1788725991.548790:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532544 00000100:00100000:2.0:1788725991.548815:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791532288:12345-0@lo:400:kworker.0 Request processed in 156us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725991.548819:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788725991.548827:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788725991.548832:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791532544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.548859:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791532288:0@lo:400:kworker.0 00000100:00100000:0.0:1788725991.548875:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791532544:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725991.548882:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788725991.548913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788725991.548920:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875614791532032:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788725991.548927:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788725991.548940:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725991.548970:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875614791532032:12345-0@lo:400:kworker.0 Request processed in 48us (645us total) trans 0 rc -107/-107 00010000:00080000:3.0:1788725991.548978:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1387635c00 x1875614791532544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725991.549023:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791531776:0@lo:38:kworker.0 00000100:00100000:1.0:1788725991.549055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725991.549093:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532160 00000100:00100000:1.0:1788725991.549097:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532160 00000100:00100000:3.0:1788725991.549164:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791532544:0@lo:400:kworker.0 00000100:00080000:3.0:1788725991.549179:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788725991.549183:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788725991.549186:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788725991.554228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788725991.554244:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875614791531904:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788725991.554255:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788725991.554347:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875614791531904:12345-0@lo:400:kworker.0 Request processed in 107us (5995us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788725991.554355:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788725991.554386:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788725991.554406:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875614791532416:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788725991.554412:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788725991.554441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875614791532416:12345-0@lo:400:kworker.0 Request processed in 35us (5947us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788725991.554447:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788725991.554471:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788725991.554512:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788725991.554517:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788725991.554520:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788725991.554525:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725991.554529:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 241 00000100:00080000:0.0:1788725991.554536:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b139e739000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725991.554565:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283cace00 x1875614791532672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725991.555706:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791532416:0@lo:400:kworker.0 00000100:00080000:0.0:1788725991.555733:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788725991.555737:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13abd39800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788725991.555741:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788725991.555745:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13abd39800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725991.555749:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 198 00000100:00080000:0.0:1788725991.555755:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b13abd39800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725991.555776:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283cae680 x1875614791532800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725991.555789:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791531904:0@lo:400:kworker.0 00000100:00100000:0.0:1788725991.555875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791531776 00000100:00100000:0.0:1788725991.555882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791531776 00000100:00100000:0.0:1788725991.555914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788725991.555920:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791531776:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788725991.555937:0:6516:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788725991.560037:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788725991.561802:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791532672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788725991.561875:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725991.561907:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791532800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788725991.561931:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725991.561964:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532672 00000100:00100000:1.0:1788725991.561971:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532672 00000100:00100000:2.0:1788725991.561981:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532800 00000100:00100000:2.0:1788725991.561988:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532800 00000100:00100000:1.0:1788725991.562005:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788725991.562013:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788725991.562020:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532672:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788725991.562038:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788725991.562086:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64us (210us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788725991.562093:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788725991.562108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788725991.562112:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532800:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788725991.562137:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788725991.564344:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532800:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 2225us (2407us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788725991.564373:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788725991.564437:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788725991.564443:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788725991.564446:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791532672:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788725991.564455:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13abd39800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788725991.564458:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788725991.564460:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791532800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788725991.565156:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791532160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788725991.565206:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791532160:12345-0@lo:400:kworker.0 Request processed in 3192us (16266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788725991.565214:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:3.0:1788725991.568609:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788725991.568618:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 219 00000100:00080000:3.0:1788725991.568626:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b1282104000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788725991.568661:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346d500 x1875614791532928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725991.568880:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791532928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788725991.569011:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791532032:0@lo:400:kworker.0 00010000:00080000:3.0:1788725991.569051:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283e31180 x1875614791532160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725991.569061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791532160:0@lo:400:kworker.0 00000100:00100000:2.0:1788725991.569101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788725991.569331:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791532928 00000100:00100000:3.0:1788725991.569338:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791532928 00000100:00100000:3.0:1788725991.569379:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788725991.569385:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532928:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788725991.569403:0:6510:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788725991.569443:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791532928:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (503us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788725991.569451:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788725991.569519:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788725991.569524:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788725991.569528:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791532928:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788725991.580708:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791531776:12345-0@lo:38:kworker.0 Request processed in 24777us (31642us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788725991.580722:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1788725991.581266:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788725991.581272:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788725991.581277:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791531776:0@lo:38:kworker.0 00010000:00010000:0.0:1788725992.316055:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788725992.891276:0:15145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b1283198e40 - data ffff9b13b8e7d798/ffff9b139e7cd800 00000020:01000000:0.0:1788725992.891438:0:15145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b13911c1300 - data ffff9b13b8c12ca8/ffff9b13bd4b8000 00000001:00000004:0.0:1788725992.900547:0:15145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788725992.960333:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788725992.960350:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788725992.960364:0:15145:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9b128346d880 x1875614791530752/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788725996 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788725992.960387:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788725992.962327:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788725992.962333:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788725992.962382:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725992.962384:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788725992.967248:0:8712:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788725992.967256:0:8712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788725992.967271:0:8712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788725992.967958:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788725992.967963:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788725992.967983:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725992.967986:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788725992.968589:0:9812:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788725992.968593:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788725992.968601:0:9812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788725992.970398:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36993 00000020:00000080:3.0:1788725992.970409:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13b4b96000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788725992.970601:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13b4b96000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788725992.974923:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d369a8 00000020:00000080:3.0:1788725992.974937:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842dd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788725992.974981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842dd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788725992.975211:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788725992.975217:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725992.975226:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788725992.975231:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b1384b53370) has no exports 00000004:01000000:3.0:1788725992.975618:0:15145:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788725992.975629:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36dde 00000020:00000080:3.0:1788725992.975634:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1283540800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788725992.975649:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788725992.975654:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725992.975716:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725992.975720:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9b13be9a99b8) has no exports 00000020:00000080:3.0:1788725992.975726:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36dd7 00000020:00000080:3.0:1788725992.975731:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1283541000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788725992.976229:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1283540800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788725992.976238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1283541000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788725992.977440:0:15145:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788725992.977446:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788725992.977459:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788725992.977466:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725992.977468:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788725992.977629:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1283543800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788725992.978337:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788725992.978350:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788725992.978355:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13af857000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788725992.978359:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13af857000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788725992.978370:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788725992.978456:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c9c 00000020:00000080:3.0:1788725992.978463:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1282101800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788725992.978478:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788725992.978482:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725992.978488:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725992.978492:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9b1282528000) has no exports 00000020:00000080:3.0:1788725992.978498:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c95 00000020:00000080:3.0:1788725992.978502:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1282216800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788725992.978920:0:15145:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788725992.978924:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788725992.978927:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788725992.978931:0:15145:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725992.978933:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788725992.978957:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788725992.979214:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282101800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788725992.979223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282216800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788725992.979230:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1282215000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788725992.979481:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788725992.979484:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1282217800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788725992.979487:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282217800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788725992.979493:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788725992.979555:0:15145:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788725992.979562:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36b4c 00000020:00000080:3.0:1788725992.979566:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b139e600800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788725992.979585:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788725992.979589:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725992.979601:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725992.979604:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b13be5dcd28) has no exports 00000020:00000080:3.0:1788725992.979609:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36b45 00000020:00000080:3.0:1788725992.979613:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b139e4fa800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788725992.979983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e600800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788725992.979992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e4fa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788725992.983237:0:15145:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788725992.983245:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788725992.983250:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788725992.983258:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788725992.983307:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725992.983319:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788725992.983349:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725992.983353:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788725992.983357:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e4fa000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788725992.983358:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13b4b97000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788725992.983362:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13b4b97000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788725992.983364:0:8:0:(genops.c:885:class_export_put()) final put ffff9b139e4fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788725992.983365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e4fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788725992.983369:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788725992.983381:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788725992.983473:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d369af 00000020:00000080:0.0:1788725992.983479:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842de800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788725992.983495:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788725992.983498:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725992.983503:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788725992.983506:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b1384b50000) has no exports 00000020:00000080:0.0:1788725992.983572:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725992.983576:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788725992.983579:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d369b6 00000020:00000080:0.0:1788725992.983583:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842d8000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788725992.983591:0:15145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139116a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788725992.983593:0:15145:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139116a000 3 00000020:01000004:0.0:1788725992.983596:0:15145:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b139116a000 from lustre-MDT0000 00000020:00000080:0.0:1788725992.983613:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725992.983616:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788725992.983618:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13b4b95800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788725992.983620:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13b4b95800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788725992.983626:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788725992.983652:0:15145:0:(obd_mount.c:589:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788725992.983655:0:15145:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788725992.983657:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788725992.983659:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725992.983662:0:15145:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788725992.983678:0:15145:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b1392b2d800 07aa06c1-b26f-4687-bdcf-2948685dbe8f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788725992.983683:0:15145:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b13a96d4d28) has exports, disconnecting them 00000020:00080000:0.0:1788725992.983687:0:15145:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b1392b2d800), last request at 1788725730 00000020:00000080:0.0:1788725992.983700:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36954 00000020:00010000:0.0:1788725992.983703:0:15145:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b1392b2d800: total 2 00000100:00080000:0.0:1788725992.983707:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9b1389f05000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788725992.983719:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b1392b2d800): rc 0 00000020:00080000:0.0:1788725992.983723:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b13a96d4d28) has no exports 00000020:00010000:0.0:1788725992.983733:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b1392b2d800: total 2 00010000:00010000:0.0:1788725992.983759:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b1392b2d800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788725992.983786:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178e00/0xa13c582691d36e71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36e6a expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983807:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae000/0xa13c582691d36e7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36e78 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983817:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2178800/0xa13c582691d36e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36e86 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983827:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179600/0xa13c582691d36e9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36e94 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983837:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030000/0xa13c582691d36a50 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36a49 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983852:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383658200/0xa13c582691d36ea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36ea2 expref: 9 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983862:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1380030800/0xa13c582691d36a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36a57 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983872:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f600/0xa13c582691d370f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d370ee expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983881:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949e400/0xa13c582691d37103 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d370fc expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983891:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13c2179e00/0xa13c582691d36e63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36e5c expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983901:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1383659800/0xa13c582691d37111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d3710a expref: 4 pid: 6506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983922:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6ae400/0xa13c582691d36d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36d6e expref: 3 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983933:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b139e6af800/0xa13c582691d36ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa13c582691d36ecc expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725992.983948:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b1392b2d800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788725992.983963:0:6499:0:(genops.c:885:class_export_put()) final put ffff9b1392b2d800/07aa06c1-b26f-4687-bdcf-2948685dbe8f 00010000:00010000:0.0:1788725992.983969:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725992.983972:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725992.983974:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788725992.984339:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842de800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788725992.984345:0:8:0:(genops.c:885:class_export_put()) final put ffff9b13b4b91800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788725992.984347:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13b4b91800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788725992.984351:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788725992.984387:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788725992.984392:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1392b2d800/07aa06c1-b26f-4687-bdcf-2948685dbe8f for MGS 00000020:00000080:1.0:1788725992.984444:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1389f05000 for MGS 00000100:00100000:3.0:1788725993.004766:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b1385c0e400:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1788725993.004895:0:6506:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b1389fbbe00:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1788725993.005228:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b1389fbbc00:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1788725993.005351:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005359:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005367:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005373:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005379:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005385:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005391:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005396:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005402:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005407:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005414:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005423:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005429:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005436:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005443:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005450:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005457:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005464:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005471:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005480:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005500:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005507:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005514:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005591:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005600:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005607:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005613:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005650:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005658:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005789:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005799:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005805:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005810:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005815:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005820:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005826:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005831:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005836:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005842:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005847:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005852:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005857:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005862:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005868:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005873:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005878:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005884:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005890:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005896:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005901:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005907:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005911:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005917:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005922:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005927:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005939:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005945:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005950:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005956:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005970:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005979:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005985:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.005994:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725993.006001:0:15145:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788725993.007849:0:15145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b12830577e0 - data ffff9b13b8ed9360/ffff9b12826fb400 00000020:01000000:0.0:1788725993.008234:0:15145:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b13848353c0 - data ffff9b13b8c80bd0/ffff9b1385dd8000 00000020:00000080:0.0:1788725993.009347:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36938 00000020:00000080:0.0:1788725993.009356:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1384e2d800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788725993.009380:0:15145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139116a000 from MGS, refs=2 00000020:01000004:0.0:1788725993.009384:0:15145:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139116a000 2 00000020:01000004:0.0:1788725993.009387:0:15145:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b139116a000 from MGS 00000020:00000080:0.0:1788725993.009412:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725993.009419:0:15145:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788725993.009423:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1384e2f000/MGS 00000020:00000080:0.0:1788725993.009426:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1384e2f000/MGS for MGS 00000020:01000000:0.0:1788725993.009437:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788725993.009476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1384e2d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788725993.009588:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788725993.009592:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725993.009599:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788725993.009606:0:15145:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b13842b9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788725993.009612:0:15145:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b13bd5b99b8) has exports, disconnecting them 00000020:00080000:0.0:1788725993.009617:0:15145:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b13842b9000), last request at 1788725730 00000020:00000080:0.0:1788725993.009622:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a03 00000020:00080000:0.0:1788725993.009634:0:15145:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b13842b9000): rc 0 00000020:00000080:0.0:1788725993.009638:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842b9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788725993.009690:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842b9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788725993.016360:0:15145:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788725993.016369:0:15145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788725993.016381:0:15145:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788725993.016387:0:15145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788725993.016471:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13842bb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788725993.016823:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725993.016830:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788725993.016835:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b13842bc000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788725993.016838:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842bc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788725993.016844:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788725993.016909:0:15145:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139116a000 1 00000020:00000080:0.0:1788725993.016914:0:15145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d3692a 00000020:00000080:0.0:1788725993.016919:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b1384e2d000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788725993.016924:0:15145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788725993.016927:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725993.016931:0:15145:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788725993.016935:0:15145:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b1384b519b8) has no exports 00000020:00000080:1.0:1788725993.016948:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1384e2d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788725993.061835:0:15145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725993.061848:0:15145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788725993.061853:0:15145:0:(genops.c:885:class_export_put()) final put ffff9b139116d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788725993.061857:0:15145:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139116d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788725993.061865:0:15145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788725993.061980:0:15145:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff9b1391169000 00000020:02000400:2.0:1788725993.062036:0:15145:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788725993.340207:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725994.363372:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788725994.620299:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791533056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788725994.620371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725994.623061:0:11341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533056 00000100:00100000:0.0:1788725994.623075:0:11341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533056 00000100:00100000:0.0:1788725994.623169:0:11341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788725994.623181:0:11341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791533056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788725994.623212:0:11341:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788725994.623276:0:11341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791533056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788725994.623283:0:11341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788725994.623303:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788725994.625292:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791533056:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788725995.069219:0:13793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788725995.389825:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725996.411305:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788725996.417896:0:15347:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788725996.430281:0:15347:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788725996.430337:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.430352:0:15347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.430359:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.430368:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.430408:0:15347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788725996.430414:0:15347:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788725996.430440:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788725996.430444:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788725996.430450:0:15347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788725996.430456:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b13abd39800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788725996.430460:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788725996.430462:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788725996.430465:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788725996.431391:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431403:0:15347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431410:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431417:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431438:0:15347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788725996.431444:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431451:0:15347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431471:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431478:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431489:0:15347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788725996.431495:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431501:0:15347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431508:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431514:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431521:0:15347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788725996.431526:0:15347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431533:0:15347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431539:0:15347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431555:0:15347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788725996.431563:0:15347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788725996.431566:0:15347:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788725996.431588:0:15347:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788725996.431593:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788725996.431597:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788725996.431602:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788725996.431609:0:15347:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9b12826e8000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788725996.431614:0:15347:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9b139f764000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788725996.431619:0:15347:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9b13bd5bcd28) has exports, disconnecting them 00000020:00080000:1.0:1788725996.431623:0:15347:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b12826e8000), last request at 1788725991 00000020:00000080:1.0:1788725996.431629:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d36 00000100:00080000:1.0:1788725996.431646:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b12826ee800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788725996.431694:0:15347:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b12826e8000): rc 0 00000020:00000080:1.0:1788725996.431696:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b12826e8000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788725996.431707:0:15347:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9b139f764000), last request at 1788725991 00000020:00000080:1.0:1788725996.431710:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c10 00000100:00080000:1.0:1788725996.431714:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b139f761800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788725996.431725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12826e8000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788725996.431761:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12826ee800 for lustre-MDT0001 00000020:00080000:1.0:1788725996.431772:0:15347:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b139f764000): rc 0 00000020:00000080:1.0:1788725996.431774:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b139f764000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788725996.431784:0:15347:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaf8241807ae0 00000020:00000080:1.0:1788725996.431793:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139f764000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788725996.431816:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139f761800 for lustre-MDT0001 00000100:00080000:1.0:1788725996.431841:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788725996.431851:0:15347:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9b1283e32680 x1875614791531136/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788726004 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788725996.431862:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1788725996.432623:0:15347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788725996.432628:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b13abd4a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788725996.432718:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788725996.432726:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432735:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725996.432747:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432757:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725996.432764:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725996.432770:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788725996.432772:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788725996.432775:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788725996.432808:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432815:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725996.432839:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432846:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2179c00/0xa13c582691d36e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36e9b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432859:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788725996.432862:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432867:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725996.432870:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432876:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725996.432888:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725996.432893:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788725996.432895:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788725996.432897:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1788725996.432912:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432917:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725996.432923:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432929:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2178a00/0xa13c582691d36ea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36ea9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432939:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788725996.432943:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432948:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6ae600 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725996.432951:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.432957:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725996.432963:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725996.432978:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788725996.432980:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788725996.432982:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788725996.432996:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433001:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725996.433016:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433023:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6ae600/0xa13c582691d36d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36d75 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433035:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788725996.433038:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433044:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658c00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725996.433046:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433053:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725996.433059:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725996.433064:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788725996.433067:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788725996.433068:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788725996.433089:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433095:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725996.433101:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433107:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383658c00/0xa13c582691d3710a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d37111 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433155:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788725996.433158:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433163:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ee00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788725996.433167:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433173:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788725996.433179:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788725996.433184:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788725996.433186:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788725996.433188:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788725996.433200:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433205:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788725996.433210:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433222:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d36a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa13c582691d36a5e expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788725996.433234:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725996.433235:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725996.433237:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788725996.433243:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725996.433388:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788725996.433411:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725996.433480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725996.433534:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791531136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788725996.433555:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788725996.433561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725996.433585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725996.433599:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725996.433617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725996.433723:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533312 00000100:00100000:0.0:1788725996.433730:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533312 00000100:00100000:0.0:1788725996.433769:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533184 00000100:00100000:0.0:1788725996.433772:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533184 00000100:00100000:0.0:1788725996.433785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533696 00000100:00100000:0.0:1788725996.433788:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533696 00000100:00100000:0.0:1788725996.433800:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788725996.433807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875614791533312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788725996.433813:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788725996 with bad export cookie 11618258061387589972 00000100:00100000:2.0:1788725996.435799:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725996.435814:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13ab293850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875614791533184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788725996.435822:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788725996 with bad export cookie 11618258061387589972 00000100:00100000:2.0:1788725996.435909:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13ab293850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875614791533184:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (2322us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788725996.435916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788725996.435941:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788725996.435945:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875614791533696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788725996.435950:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788725996 with bad export cookie 11618258061387589972 00000100:00100000:2.0:1788725996.435975:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875614791533696:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (2358us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788725996.435981:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788725996.436022:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788725996.436026:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13881bf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788725996.436029:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788725996.440381:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875614791533312:12345-0@lo:103:ldlm_bl.0 Request processed in 6568us (6895us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788725996.440394:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788725996.450539:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788725996.450545:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788725996.450554:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b1283caca80 x1875614791533312/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788726012 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725996.450583:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b1283caf480 x1875614791533184/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788726012 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788725996.450593:0:3641:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128259ad80 x1875614791533696/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788726012 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788725996.450601:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788725996.450605:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788725996.450606:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788725996.450736:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07aa06c1-b26f-4687-bdcf-2948685dbe8f:0:1875614791533568:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788725996.451250:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788725996.451254:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788725996.451266:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788725996.451338:0:15347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788725996.451362:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b1281a14800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788725996.451381:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788725996.451383:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788725996.451392:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788725996.451456:0:15347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788725996.451465:0:15347:0:(import.c:65:import_set_state_nolock()) ffff9b12834b3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788725996.451487:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b13bd5bcd28) has no exports 00000100:00100000:3.0:1788725996.451574:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07aa06c1-b26f-4687-bdcf-2948685dbe8f:0:1875614791533440:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788725996.453029:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9b13881bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788725996.453039:0:3641:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 175 00000100:00080000:2.0:1788725996.453047:0:3641:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9b13881bf800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788725996.453067:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791533824:0@lo:9:umount.0 00000100:00100000:2.0:1788725996.453165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725996.453202:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791533952:0@lo:9:umount.0 00000100:00100000:2.0:1788725996.453224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788725996.453482:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387637800 x1875614791534080/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788725996.453509:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791534080:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788725996.453529:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875614791534080 offset 0 length 520: 4 00000100:00100000:2.0:1788725996.453567:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725996.453576:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788725996.453596:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3641:1875614791533184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788725996.453775:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533824 00000100:00100000:3.0:1788725996.453783:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533824 00000100:00100000:3.0:1788725996.453826:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791533952 00000100:00100000:3.0:1788725996.453829:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791533952 00000100:00100000:3.0:1788725996.453853:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788725996.453862:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875614791533824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788725996.453886:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c5d 00000100:00080000:3.0:1788725996.453893:0:8425:0:(import.c:65:import_set_state_nolock()) ffff9b13abd3e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788725996.453929:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788725996.454746:0:8716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788725996.454758:0:8716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875614791533952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788725996.454791:0:8716:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36da6 00000100:00080000:2.0:1788725996.454798:0:8716:0:(import.c:65:import_set_state_nolock()) ffff9b139e604000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788725996.454832:0:8716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788725996.454946:0:8716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1875614791533952:12345-0@lo:9:umount.0 Request processed in 191us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788725996.454953:0:8716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788725996.454993:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b12834b3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788725996.455005:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788725996.455007:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788725996.455010:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791533952:0@lo:9:umount.0 00010000:00010000:2.0:1788725996.455035:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788725996.455168:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3637:x1875614791533824:12345-0@lo:9:umount.0 Request processed in 1307us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788725996.455175:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788725996.457305:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1281a14800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788725996.457330:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788725996.457332:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788725996.457337:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791533824:0@lo:9:umount.0 00000100:00080000:2.0:1788725996.457769:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788725996.457774:0:6507:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788725996.458584:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788725996.466875:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b13bd5bcd28) has no exports 00000020:01000000:0.0:1788725996.558519:0:15347:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b1283198ea0 - data ffff9b13b8ed80d8/ffff9b139e7cf000 00000020:01000000:0.0:1788725996.558683:0:15347:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b139e42d300 - data ffff9b13b8c146c0/ffff9b139e4ba800 00000001:00000004:0.0:1788725996.571267:0:15347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788725996.626469:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788725996.626479:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788725996.626486:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788725996.642857:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788725996.642865:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788725996.643070:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725996.643074:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788725996.654831:0:8701:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788725996.654841:0:8701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788725996.654860:0:8701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788725996.655489:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788725996.655508:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788725996.655525:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725996.655542:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788725996.656171:0:9806:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788725996.656176:0:9806:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788725996.656184:0:9806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788725996.657338:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a7a 00000020:00000080:3.0:1788725996.657348:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd4c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788725996.657826:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd4c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788725996.660448:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a8f 00000020:00000080:3.0:1788725996.660459:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd4e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788725996.660513:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788725996.660518:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725996.660526:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788725996.660529:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b13bd5bb370) has no exports 00000004:01000000:3.0:1788725996.660996:0:15347:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788725996.661006:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d98 00000020:00000080:3.0:1788725996.661011:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b12834b0800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788725996.670909:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788725996.670948:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725996.670961:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725996.671852:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9b128252cd28) has no exports 00000020:00000080:3.0:1788725996.671863:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d91 00000020:00000080:3.0:1788725996.671872:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b12834b1000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788725996.675151:0:15347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788725996.675160:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788725996.675164:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788725996.675172:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725996.675174:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788725996.675213:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788725996.675224:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788725996.675233:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c56 00000020:00000080:3.0:1788725996.675241:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd3d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788725996.675248:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788725996.675255:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725996.675261:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725996.675265:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9b13bd49cd28) has no exports 00000020:00000080:3.0:1788725996.675272:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c4f 00000020:00000080:3.0:1788725996.675275:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b1281a13000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788725996.675871:0:15347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788725996.675874:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788725996.675877:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788725996.675881:0:15347:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788725996.675883:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788725996.676066:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788725996.676073:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788725996.676086:0:15347:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788725996.676091:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36ab2 00000020:00000080:3.0:1788725996.676096:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd4b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788725996.676101:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788725996.676105:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788725996.676109:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788725996.676141:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b13be5db370) has no exports 00000020:00000080:3.0:1788725996.676145:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36aab 00000020:00000080:3.0:1788725996.676149:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd4a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788725996.677868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd4e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000100:00080000:0.0:1788725996.677886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788725996.677912:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788725996.677915:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725996.677921:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1788725996.677927:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788725996.677932:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b1282104000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725996.678912:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598a80 x1875614791534208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788725996.678987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788725996.678992:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788725996.678994:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725996.678998:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1788725996.679001:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788725996.679005:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b139e739000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725996.679020:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598700 x1875614791534464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1788725996.679064:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12834b0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788725996.679073:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12834b1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788725996.679081:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b12834b3800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788725996.679089:0:37:0:(genops.c:885:class_export_put()) final put ffff9b12826e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788725996.679092:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12826e8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788725996.679096:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788725996.679214:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd3d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788725996.679220:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a13000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788725996.679224:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1281a14800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788725996.679229:0:37:0:(genops.c:885:class_export_put()) final put ffff9b1281a16000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788725996.679242:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a16000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788725996.679245:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788725996.679281:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd4b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788725996.679286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd4a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000100:00100000:0.0:1788725996.679326:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791534208:0@lo:38:kworker.0 00000100:00100000:0.0:1788725996.679387:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725996.679432:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791534464:0@lo:38:kworker.0 00000100:00100000:0.0:1788725996.679452:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725996.679483:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788725996.679490:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788725996.682289:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788725996.682314:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791534592:0@lo:400:kworker.0 00000100:00100000:1.0:1788725996.682378:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725996.682448:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534208 00000100:00100000:1.0:1788725996.682456:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534208 00000100:00100000:1.0:1788725996.682491:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534464 00000100:00100000:1.0:1788725996.682494:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534464 00000100:00100000:1.0:1788725996.682516:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534592 00000100:00100000:1.0:1788725996.682519:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534592 00000100:00100000:1.0:1788725996.682535:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788725996.682542:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788725996.682573:0:9522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788725996.682608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788725996.682617:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534208:12345-0@lo:38:kworker.0 Request processed in 74us (3229us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788725996.682624:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788725996.682634:0:11950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534336 00000100:00100000:0.0:1788725996.682638:0:11950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534336 00000100:00100000:1.0:1788725996.682639:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788725996.682643:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534464:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788725996.682652:0:9522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788725996.682666:0:11950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788725996.682675:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534464:12345-0@lo:38:kworker.0 Request processed in 31us (3223us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788725996.682680:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788725996.682690:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788725996.682693:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875614791534336:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788725996.682698:0:9522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788725996.682723:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875614791534336:12345-0@lo:400:kworker.0 Request processed in 28us (114us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788725996.682729:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788725996.682782:0:11950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875614791534592:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788725996.682789:0:11950:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788725996.682817:0:11950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875614791534592:12345-0@lo:400:kworker.0 Request processed in 145us (440us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788725996.682823:0:11950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788725996.682857:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788725996.682862:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788725996.682866:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791534208:0@lo:38:kworker.0 00000100:00080000:0.0:1788725996.682873:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788725996.682877:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788725996.682879:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791534464:0@lo:38:kworker.0 00000100:00080000:0.0:1788725996.683039:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788725996.683048:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3f800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788725996.683052:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:01000000:2.0:1788725996.688196:0:15347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788725996.688206:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788725996.688211:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788725996.688220:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788725996.688279:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725996.688303:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788725996.688331:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725996.688335:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788725996.688341:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd49000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788725996.688345:0:15347:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd49000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788725996.688356:0:15347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788725996.688648:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a96 00000020:00000080:2.0:1788725996.688656:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd48000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788725996.688661:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788725996.688665:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788725996.688788:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788725996.688794:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9b13bd5b8000) has no exports 00000020:00000080:2.0:1788725996.688825:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725996.688830:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788725996.688835:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a9d 00000020:00000080:2.0:1788725996.688840:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd49800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788725996.688847:0:15347:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b13bd660800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788725996.688851:0:15347:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b13bd660800 2 00000020:01000004:2.0:1788725996.688853:0:15347:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b13bd660800 from lustre-MDT0001 00000020:00000080:2.0:1788725996.688873:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725996.688877:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788725996.688879:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd4b000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788725996.688881:0:15347:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd4b000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788725996.688889:0:15347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788725996.689057:0:15347:0:(obd_mount.c:589:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788725996.689063:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788725996.689066:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788725996.689070:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788725996.689076:0:15347:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9b13abd3c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788725996.689081:0:15347:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9b139e4319b8) has exports, disconnecting them 00000020:00080000:2.0:1788725996.689086:0:15347:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9b13abd3c000), last request at 1788725753 00000020:00000080:2.0:1788725996.689097:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36af1 00000020:00080000:2.0:1788725996.689135:0:15347:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b13abd3c000): rc 0 00000020:00000080:2.0:1788725996.689141:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd3c000/lustre-MDT0000-lwp-MDT0001 00000100:00080000:0.0:1788725996.703489:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725996.703812:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 219 00000100:00080000:0.0:1788725996.703821:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b1281a3f800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725996.703859:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598700 x1875614791534720/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725996.703890:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791534336:0@lo:400:kworker.0 00000100:00080000:0.0:1788725996.703962:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788725996.703976:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788725996.703980:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788725996.703984:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788725996.703987:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 241 00000100:00080000:0.0:1788725996.703991:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b13af852000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788725996.704005:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598e00 x1875614791534848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788725996.704017:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1875614791534592:0@lo:400:kworker.0 00000100:00100000:0.0:1788725996.704042:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791534720:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788725996.704100:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725996.704189:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791534848:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788725996.704213:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788725996.704249:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534720 00000100:00100000:0.0:1788725996.704264:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534720 00000100:00100000:0.0:1788725996.704293:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791534848 00000100:00100000:0.0:1788725996.704296:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791534848 00000100:00100000:0.0:1788725996.704313:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788725996.704321:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534720:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788725996.704339:0:9522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788725996.704380:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534720:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 59us (280us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788725996.704388:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788725996.704403:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788725996.704407:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534848:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788725996.704416:0:9522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788725996.704440:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1875614791534848:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (226us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788725996.704446:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:0.0:1788725996.706805:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788725996.706817:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788725996.706822:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791534720:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788725996.706835:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788725996.706839:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788725996.706842:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791534848:0@lo:38:ptlrpcd_00_01.0 00000020:00000080:0.0:1788725996.712333:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13abd4a800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788725996.712351:0:36:0:(genops.c:885:class_export_put()) final put ffff9b13be5cb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788725996.712356:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13be5cb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788725996.712369:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788725996.712535:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd48000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788725996.712541:0:36:0:(genops.c:885:class_export_put()) final put ffff9b13abd48800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788725996.712543:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd48800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788725996.712547:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788725996.712896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd49800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788725996.712912:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd3c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788725996.720706:0:15347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788725996.720715:0:15347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788725996.720720:0:15347:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788725996.720727:0:15347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788725996.720753:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13abd39800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788725996.720918:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788725996.720927:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788725996.720932:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13abd3b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788725996.720935:0:15347:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd3b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788725996.720941:0:15347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788725996.721027:0:15347:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b13bd660800 1 00000020:00000080:0.0:1788725996.721033:0:15347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36a2d 00000020:00000080:0.0:1788725996.721039:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13bd4af000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788725996.721047:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788725996.721055:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13bd4af000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788725996.721064:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788725996.721068:0:15347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788725996.721071:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b13a96d3370) has no exports 00000020:00000080:2.0:1788725996.979918:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788725996.979930:0:15347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788725996.979935:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13bd665800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788725996.979940:0:15347:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13bd665800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788725996.979951:0:15347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788725996.980352:0:15347:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff9b13bd664800 00000020:01000000:2.0:1788725996.980370:0:15347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788725996.980374:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788725996.980378:0:15347:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788725996.980382:0:15347:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b13a96d19b8) has no exports 00000100:00100000:1.0:1788725996.982838:0:9522:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b128326e600:9522] 3 exiting: rc = 0 00000100:00100000:1.0:1788725996.984275:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b1384842200:6512] 2 exiting: rc = 0 00000100:00100000:1.0:1788725996.984377:0:11950:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9b12830fc400:11950] 4 exiting: rc = 0 00000100:00100000:3.0:1788725996.989285:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b13848b1400:6510] 0 exiting: rc = 1 00000100:00100000:0.0:1788725996.998248:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b1384842e00:6511] 1 exiting: rc = 0 00000100:00100000:2.0:1788725997.000304:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000316:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000322:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000327:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000332:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000337:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000359:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000365:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000370:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000376:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000381:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000386:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000592:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000599:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000604:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000610:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000615:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000620:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000625:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000631:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000651:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000657:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000663:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000669:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000674:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000680:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000687:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000692:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000697:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000702:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000707:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000712:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000718:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000724:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000730:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000735:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000741:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000746:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000751:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000756:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000762:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000767:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000772:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000779:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000784:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000790:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000795:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000800:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000806:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000811:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000816:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000821:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000826:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000831:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000836:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000849:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000854:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000858:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000863:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000869:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000873:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000878:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000883:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.000897:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.007602:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b1384842000:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1788725997.007727:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b1384842800:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1788725997.007815:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007824:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007829:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007835:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007841:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007846:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007852:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007858:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007863:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007868:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007873:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007879:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007885:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007890:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007895:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007900:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007905:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007921:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007926:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007930:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007935:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007940:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007945:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007951:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007956:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007961:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007967:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007972:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007976:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007982:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007989:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007994:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.007999:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008004:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008009:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008014:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008020:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008025:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008030:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008036:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008042:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008048:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008053:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008059:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008077:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008083:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008088:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008094:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008100:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008106:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008177:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008184:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008195:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008201:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008206:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008211:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008216:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008221:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008227:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008234:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008239:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008245:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008249:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788725997.008254:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.008787:0:7833:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9b139e451e00:7833] 2 exiting: rc = 0 00000100:00100000:2.0:1788725997.008866:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b1392a58c00:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1788725997.009560:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b13a96b3000:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1788725997.009808:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009831:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009840:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009850:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009856:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009862:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009868:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009880:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009887:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009893:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009899:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009905:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009911:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009917:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009922:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.009930:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010925:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010938:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010944:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010968:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010975:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.010993:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011001:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011008:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011015:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011020:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011027:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011034:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011042:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011051:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.011058:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012365:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012533:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012543:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012549:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012555:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012560:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012565:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012572:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012578:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012584:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012590:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012596:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012618:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012625:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012631:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012638:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012644:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012651:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012657:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012663:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012668:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012675:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012680:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012687:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012708:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012725:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012730:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012736:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012742:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012747:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012753:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012759:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788725997.012772:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.052456:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b139533d000:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1788725997.054048:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b13a96b0a00:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1788725997.054318:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054326:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054332:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054337:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054342:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054348:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054354:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054371:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054377:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054383:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054388:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054393:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054398:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054403:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054409:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054416:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054421:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054426:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054431:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054436:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054441:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054446:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054451:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054456:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054461:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054466:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054471:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054476:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054481:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054485:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054490:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054495:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054500:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054505:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054511:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054515:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054520:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054526:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054531:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054536:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054542:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054546:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054558:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054563:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054568:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054573:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054578:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054583:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054588:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054593:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054598:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054603:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054607:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054612:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054617:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054622:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054627:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054632:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054638:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054643:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054648:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054653:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054658:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.054663:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725997.059300:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b1382a8f600:6519] 0 exiting: rc = 1 00000100:00100000:3.0:1788725997.065593:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b13a96b1c00:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1788725997.066105:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066137:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066142:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066147:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066153:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066279:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066288:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066293:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066299:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066305:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066311:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066316:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066322:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066345:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066350:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066356:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066361:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066366:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066371:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066377:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066382:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066387:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066393:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066398:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066403:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066409:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066414:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066419:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066424:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066429:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066434:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066440:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066445:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066450:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066455:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066461:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066467:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066472:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066478:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066484:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066490:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066495:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066500:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066505:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066510:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066515:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066520:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066525:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066538:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066544:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066549:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066554:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066559:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066565:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066570:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066576:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066581:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066587:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066593:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066598:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066603:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066608:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066613:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.066619:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788725997.068431:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b1382a8ea00:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1788725997.068595:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b13a96b0e00:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1788725997.071274:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071285:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071291:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071295:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071300:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071306:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071312:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071317:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071323:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071328:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071333:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071338:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071343:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071348:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071354:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071359:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071364:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071369:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071374:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071394:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071400:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071404:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071410:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071415:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071419:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071424:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071429:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071434:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071439:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071444:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071449:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071454:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071459:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071464:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071470:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071475:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071480:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071486:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071492:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071498:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071503:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071508:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071514:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071520:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071525:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071530:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071536:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071541:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071546:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071551:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071557:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071562:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071569:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071574:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071587:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071592:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071598:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071603:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071609:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071614:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071619:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071624:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071629:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.071635:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.072215:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b13a7de9800:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1788725997.073278:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b13a7de9400:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788725997.073445:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b138484fa00:6525] 2 exiting: rc = 0 00000100:00100000:1.0:1788725997.074602:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074613:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074620:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074625:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074630:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074635:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074642:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074647:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074654:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074660:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074665:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074672:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074677:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074683:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074690:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074695:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074701:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074706:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074712:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074719:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074724:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074730:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074736:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074741:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074771:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074778:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074783:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074789:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074794:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074799:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074804:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074811:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074818:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074823:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074828:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074833:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074839:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074844:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074850:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074855:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074861:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074866:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074872:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074877:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074882:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074887:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074892:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074898:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074920:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074928:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074933:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074939:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074944:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074951:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074957:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074963:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074969:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074975:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074981:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074993:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.074998:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.075008:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.075014:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788725997.075020:0:15347:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788725997.088550:0:15347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788725997.088565:0:15347:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788725997.088571:0:15347:0:(genops.c:885:class_export_put()) final put ffff9b13881bc000/MDS_uuid 00000020:00000080:1.0:1788725997.088576:0:15347:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13881bc000/MDS_uuid for MDS 00000020:01000000:1.0:1788725997.088588:0:15347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788725997.088743:0:15347:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788725997.441340:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788725998.460287:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788725999.483321:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726000.511165:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726001.532208:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788726001.608310:0:15548:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788726001.637070:0:15548:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788726001.637176:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.637190:0:15548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.637198:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.637205:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.637454:0:15548:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788726001.637473:0:15548:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788726001.637511:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726001.637515:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788726001.637522:0:15548:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788726001.637528:0:15548:0:(import.c:65:import_set_state_nolock()) ffff9b1282104000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788726001.637534:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726001.637535:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788726001.637538:0:15548:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788726001.642656:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788726001.642665:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788726001.642672:0:15548:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788726001.642679:0:15548:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788726001.642685:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788726001.642686:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788726001.642690:0:15548:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788726001.644923:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.644942:0:15548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.644949:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.644955:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645133:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726001.645141:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645149:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148bc00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726001.645153:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645162:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726001.645169:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726001.645175:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788726001.645178:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788726001.645180:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788726001.645193:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726001.645197:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645218:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148bc00/0xa13c582691d36e78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645231:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726001.645234:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645239:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726001.645242:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645248:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726001.645254:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726001.645259:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788726001.645261:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788726001.645265:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726001.645267:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645273:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726001.645274:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726001.645276:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726001.645620:0:15548:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726001.645627:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b138148a400/0xa13c582691d36e86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.645655:0:15548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.645662:0:15548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.645668:0:15548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726001.645675:0:15548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645806:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726001.645811:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645827:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2044200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726001.645830:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645836:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726001.645842:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726001.645847:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788726001.645849:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788726001.645856:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726001.645859:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726001.645866:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726001.645868:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726001.645870:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726001.645982:0:15548:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726001.645987:0:15548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13c2044200/0xa13c582691d370fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d37103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726001.645998:0:15548:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788726001.646002:0:15548:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788726001.646004:0:15548:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788726001.646031:0:15548:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788726001.646035:0:15548:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788726001.646040:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726001.646045:0:15548:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788726001.646052:0:15548:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9b13abd38800 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:3.0:1788726001.646057:0:15548:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9b139e434d28) has no exports 00000020:00080000:3.0:1788726001.646088:0:15548:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9b139e434d28) has no exports 00010000:00010000:2.0:1788726001.650774:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788726001.787404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726001.787412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726001.787416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726001.787419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788726001.787423:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726001.787431:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1788726001.787437:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788726001.787444:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b139e739000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726001.787483:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128375a300 x1875614791534976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726001.787507:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726001.787510:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788726001.787512:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726001.787516:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1788726001.787518:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788726001.787522:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b13af852000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726001.787534:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128375bb80 x1875614791535104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788726001.787789:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791534976:0@lo:38:kworker.0 00000400:00000100:2.0:1788726001.787838:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614791534976 offset 0 length 520: 4 00000100:00100000:2.0:1788726001.787893:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791535104:0@lo:38:kworker.0 00000400:00000100:2.0:1788726001.787920:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875614791535104 offset 0 length 520: 4 00000001:00100000:1.0:1788726001.789731:0:9505:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788726001.789739:0:9505:0:(genops.c:885:class_export_put()) final put ffff9b139e606000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788726001.792315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e606000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788726001.792387:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e604000 for lustre-OST0001 00000001:00100000:0.0:1788726001.805332:0:8420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788726001.805341:0:8420:0:(genops.c:885:class_export_put()) final put ffff9b13abd38800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788726001.805767:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13abd38800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788726001.805833:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13abd3e000 for lustre-OST0000 00010000:00010000:2.0:1788726002.555283:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726003.580415:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788726003.714462:0:15548:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b1283057d20 - data ffff9b13b8d95000/ffff9b139e777c00 00000020:01000000:3.0:1788726003.714600:0:15548:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b1388851c00 - data ffff9b13b8e58360/ffff9b1281a23c00 00100000:10000000:3.0:1788726003.721348:0:15548:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788726003.729297:0:15548:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36bca 00000020:00000080:0.0:1788726003.729308:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b1281a3c800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788726003.729331:0:15548:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139e52d000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788726003.729335:0:15548:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139e52d000 2 00000020:01000004:0.0:1788726003.729338:0:15548:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b139e52d000 from lustre-OST0000 00000020:00000080:0.0:1788726003.729358:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726003.729367:0:15548:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788726003.729370:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b1281a3a800/lustre-OST0000_UUID 00000020:00000080:0.0:1788726003.729372:0:15548:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a3a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788726003.729379:0:15548:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788726003.729425:0:15548:0:(obd_mount.c:589:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788726003.729429:0:15548:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788726003.729432:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726003.729437:0:15548:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788726003.729443:0:15548:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b1282106800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788726003.729448:0:15548:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9b13be5d8000) has exports, disconnecting them 00000020:00080000:0.0:1788726003.729453:0:15548:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b1282106800), last request at 1788725774 00000020:00000080:0.0:1788726003.729457:0:15548:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36bf4 00000020:00080000:0.0:1788726003.729467:0:15548:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b1282106800): rc 0 00000020:00000080:0.0:1788726003.729471:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b1282106800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788726003.729677:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a3c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788726003.729685:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282106800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788726003.734080:0:15548:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788726003.734089:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788726003.734093:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788726003.734100:0:15548:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788726003.734536:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726003.734545:0:15548:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788726003.734551:0:15548:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788726003.734556:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726003.734560:0:15548:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788726003.734568:0:15548:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9b1281a38000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788726003.734574:0:15548:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9b139e430000) has exports, disconnecting them 00000020:00080000:1.0:1788726003.734578:0:15548:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9b1281a38000), last request at 1788725774 00000020:00000080:1.0:1788726003.734582:0:15548:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36c02 00000020:00080000:1.0:1788726003.734595:0:15548:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b1281a38000): rc 0 00000020:00000080:1.0:1788726003.734601:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b1281a38000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788726003.747209:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1282104000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788726003.747225:0:37:0:(genops.c:885:class_export_put()) final put ffff9b139e607000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788726003.747229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e607000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788726003.747240:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788726003.747306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a38000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788726003.747419:0:15548:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788726003.747423:0:15548:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788726003.747428:0:15548:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788726003.747432:0:15548:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788726003.747454:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b1281a3f800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788726003.747598:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788726003.747605:0:15548:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788726003.747609:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b1281a3e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788726003.747611:0:15548:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1281a3e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788726003.747615:0:15548:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788726003.747643:0:15548:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139e52d000 1 00000020:00000080:2.0:1788726003.747649:0:15548:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36b92 00000020:00000080:2.0:1788726003.747655:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b13be715000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788726003.747663:0:15548:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788726003.747670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13be715000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788726003.747817:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788726003.748214:0:15548:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788726003.748220:0:15548:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9b139e433370) has no exports 00000020:00000080:2.0:1788726003.909868:0:15548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788726003.909881:0:15548:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788726003.909887:0:15548:0:(genops.c:885:class_export_put()) final put ffff9b13842ba000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788726003.909901:0:15548:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13842ba000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788726003.909911:0:15548:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788726003.910021:0:15548:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff9b13842ba800 00000020:02000400:2.0:1788726003.910256:0:15548:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788726004.604205:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726005.644156:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726006.652530:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788726006.909320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726006.909332:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726006.909335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726006.909338:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726006.909341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788726006.909344:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788726006.917640:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788725996/real 1788725996] req@ffff9b1387637800 x1875614791534080/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788726006 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726006.917680:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b1387637800 x1875614791534080/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788726006 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726006.917699:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13881bf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726006.917736:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788726006.917741:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791534080:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788726006.918177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788726006.918182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788726006.918185:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13881bf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726006.918190:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1788726006.918195:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788726006.918201:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9b13881bf800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726006.918237:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346d880 x1875614791535232/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726006.918259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788726006.918263:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726006.918265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788726006.918268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788726006.919175:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791535232:0@lo:250:kworker.0 00000400:00000100:0.0:1788726006.919226:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875614791535232 offset 0 length 520: 4 00010000:00010000:0.0:1788726007.675885:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788726008.048577:0:15749:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788726008.063854:0:15749:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788726008.063937:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.063950:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.063957:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.063965:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.064005:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788726008.064011:0:15749:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788726008.064043:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726008.064054:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128375a300 x1875614791534976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788726021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726008.064075:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788726008.064081:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788726008.064087:0:15749:0:(import.c:65:import_set_state_nolock()) ffff9b139e739000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788726008.064091:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788726008.064095:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128375a300 x1875614791534976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788726021 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726008.064102:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788726008.064105:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1788726008.064300:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791534976:0@lo:38:kworker.0 00010000:00010000:2.0:1788726008.065202:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726008.065213:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.065223:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726008.065227:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.065245:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726008.065254:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726008.065260:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788726008.065263:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788726008.065265:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788726008.065279:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726008.065283:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.065290:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383658a00/0xa13c582691d36e5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e63 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.065302:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726008.065303:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726008.065305:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788726008.065504:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788726008.065514:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128375bb80 x1875614791535104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788726016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726008.065576:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788726008.065582:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788726008.065587:0:15749:0:(import.c:65:import_set_state_nolock()) ffff9b13af852000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788726008.065592:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788726008.065595:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128375bb80 x1875614791535104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788726016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726008.066205:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788726008.066228:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791535104:0@lo:38:kworker.0 00000100:00100000:3.0:1788726008.066274:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788726008.067415:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067447:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067455:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067462:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067481:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726008.067488:0:15749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067495:0:15749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067501:0:15749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067508:0:15749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726008.067563:0:15749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788726008.067574:0:15749:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788726008.067602:0:15749:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788726008.067607:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788726008.067612:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788726008.067617:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788726008.067622:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9b128252b370) has no exports 00000020:00080000:3.0:1788726008.067648:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9b128252b370) has no exports 00000020:01000000:3.0:1788726008.069624:0:15749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b12830575a0 - data ffff9b13b8ee2bd0/ffff9b139e775800 00000020:01000000:3.0:1788726008.069754:0:15749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b1282368ae0 - data ffff9b1281d3be58/ffff9b139e693800 00010000:00010000:0.0:1788726008.070480:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726008.070490:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726008.070501:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b139e6aec00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788726008.070505:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726008.070515:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726008.070523:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726008.070529:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788726008.070532:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788726008.070535:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788726008.070551:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:0.0:1788726008.070555:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.071005:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726008.071070:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.071078:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1383658400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726008.071081:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.071088:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726008.071095:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726008.071100:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788726008.071102:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788726008.071104:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788726008.071113:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:0.0:1788726008.071264:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b139e6aec00/0xa13c582691d36e6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36e71 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726008.071276:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726008.071278:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726008.071279:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726008.071313:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.071321:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1383658400/0xa13c582691d370ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d370f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.071336:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726008.071337:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726008.071338:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788726008.081992:0:15749:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788726008.089430:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36cf0 00000020:00000080:2.0:1788726008.089440:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b12826ea000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788726008.089461:0:15749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1282214000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788726008.089464:0:15749:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1282214000 2 00000020:01000004:2.0:1788726008.089476:0:15749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b1282214000 from lustre-OST0001 00000020:00000080:2.0:1788726008.089498:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788726008.089507:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788726008.089507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12826ea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788726008.089510:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b12826ed000/lustre-OST0001_UUID 00000020:00000080:2.0:1788726008.089512:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9b12826ed000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788726008.089518:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788726008.089873:0:15749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 07aa06c1-b26f-4687-bdcf-2948685dbe8f->MGS 00010000:00010000:2.0:1788726008.089888:0:15749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f000/0xa13c582691d36a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726008.089900:0:15749:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f000/0xa13c582691d36a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726008.089908:0:15749:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788726008.089910:0:15749:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788726008.089914:0:15749:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788726008.089930:0:15749:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726008.089934:0:15749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f000/0xa13c582691d36a49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36a50 expref: -99 pid: 7440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726008.089948:0:15749:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726008.089954:0:15749:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726008.089959:0:15749:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788726008.089961:0:15749:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788726008.089962:0:15749:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788726008.089978:0:15749:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b13881bf800 00010000:00010000:2.0:1788726008.089981:0:15749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1380031c00/0xa13c582691d36ecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa13c582691d36ed3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788726008.090009:0:15749:0:(import.c:65:import_set_state_nolock()) ffff9b13881bf800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788726008.090013:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788726008.090015:0:15749:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788726008.090017:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788726008.090020:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788726008.090030:0:15749:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b128346d880 x1875614791535232/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788726021 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788726008.090060:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788726008.090064:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1788726008.090167:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07aa06c1-b26f-4687-bdcf-2948685dbe8f:3637:1875614791535232:0@lo:250:kworker.0 10000000:01000000:2.0:1788726008.090206:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788726008.090212:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36946 00000020:00000080:2.0:1788726008.090217:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b13881be000/07aa06c1-b26f-4687-bdcf-2948685dbe8f 00000020:01000000:2.0:1788726008.090237:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:2.0:1788726008.090242:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788726008.090246:0:15749:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788726008.090250:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b13a96d0000) has no exports 00000020:00000080:0.0:1788726008.090257:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13881be000/07aa06c1-b26f-4687-bdcf-2948685dbe8f for MGC192.168.203.112@tcp 10000000:01000000:1.0:1788726008.090297:0:6509:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788726008.090346:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:2.0:1788726008.090349:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788726008.090351:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788726008.090353:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788726008.090355:0:15749:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788726008.090395:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788726008.090400:0:15749:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid 07aa06c1-b26f-4687-bdcf-2948685dbe8f) 00000020:01000000:2.0:1788726008.090405:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788726008.090408:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788726008.090411:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788726008.090415:0:15749:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b139e73b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1788726008.090416:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13881bf800 for MGC192.168.203.112@tcp 00000020:00080000:2.0:1788726008.090420:0:15749:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9b13bd498000) has exports, disconnecting them 00000020:00000080:0.0:1788726008.090422:0:37:0:(genops.c:885:class_export_put()) final put ffff9b13881b8800/07aa06c1-b26f-4687-bdcf-2948685dbe8f 00000020:00080000:2.0:1788726008.090424:0:15749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b139e73b800), last request at 1788725796 00000020:00000080:0.0:1788726008.090425:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13881b8800/07aa06c1-b26f-4687-bdcf-2948685dbe8f for MGC192.168.203.112@tcp 00000020:00000080:2.0:1788726008.090428:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d1a 00000020:01000000:0.0:1788726008.090429:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (07aa06c1-b26f-4687-bdcf-2948685dbe8f) 00000020:00080000:2.0:1788726008.090443:0:15749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b139e73b800): rc 0 00000020:00000080:2.0:1788726008.090447:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b139e73b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788726008.090772:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e73b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788726008.091203:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788726008.091207:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788726008.091210:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788726008.091218:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788726008.091918:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788726008.091926:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788726008.091932:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788726008.091936:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788726008.091939:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788726008.091945:0:15749:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9b13af852800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788726008.091951:0:15749:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9b13be9a8000) has exports, disconnecting them 00000020:00080000:0.0:1788726008.091954:0:15749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9b13af852800), last request at 1788725796 00000020:00000080:0.0:1788726008.091966:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36d2f 00000020:00080000:0.0:1788726008.091979:0:15749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b13af852800): rc 0 00000020:00000080:0.0:1788726008.091984:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b13af852800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788726008.093942:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b139e739000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788726008.093965:0:37:0:(genops.c:885:class_export_put()) final put ffff9b139e73e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788726008.093969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b139e73e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788726008.093978:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788726008.094757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13af852800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788726008.111179:0:15749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788726008.111188:0:15749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788726008.111196:0:15749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788726008.111208:0:15749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788726008.111246:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b13af852000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788726008.121066:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788726008.133101:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788726008.134139:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788726008.134420:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b1389a56200:6494] 0 exiting: rc = 1 00000100:00100000:2.0:1788726008.142432:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b1389a57800:6495] 1 exiting: rc = 0 00000100:00100000:1.0:1788726008.193316:0:10329:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9b12830fd400:10329] 2 exiting: rc = 0 00000100:00100000:1.0:1788726008.193430:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.193676:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b1389a56e00:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1788726008.195249:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b13851f7200:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1788726008.196385:0:10330:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b12830fc000:10330] 3 exiting: rc = 0 00000100:00100000:3.0:1788726008.196487:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b1389fbb800:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1788726008.197229:0:15146:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9b1282096600:15146] 4 exiting: rc = 0 00000100:00100000:1.0:1788726008.197315:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197323:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197329:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197335:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197340:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197346:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197352:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197361:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197369:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197374:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197380:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197385:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197403:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197409:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197415:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197421:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197427:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197434:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197440:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197447:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197452:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197458:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197463:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197468:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197473:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197479:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197485:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197490:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197496:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197501:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197506:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197512:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197518:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197523:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197529:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197534:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197540:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197546:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197552:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197557:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197562:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197568:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197573:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197579:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197584:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197589:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197594:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197617:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197623:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197629:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197634:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197639:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197644:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197649:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197654:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197659:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197664:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197668:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197673:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197685:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197691:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197704:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197710:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.197716:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788726008.198442:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726008.198452:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788726008.198459:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b13af854000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788726008.198463:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13af854000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788726008.198468:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788726008.198512:0:15749:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1282214000 1 00000020:00000080:1.0:1788726008.198518:0:15749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa13c582691d36cbf 00000020:00000080:1.0:1788726008.198523:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b1282107000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788726008.198534:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788726008.198544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282107000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788726008.198554:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726008.198559:0:15749:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788726008.198563:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9b12825299b8) has no exports 00000020:00000080:1.0:1788726008.267211:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726008.267225:0:15749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788726008.267231:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b1282213000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788726008.267246:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9b1282213000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788726008.267256:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788726008.267571:0:15749:0:(obd_mount.c:679:lustre_free_lsi()) Freeing lsi ffff9b1282214800 00000020:01000000:1.0:1788726008.267794:0:15749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788726008.267799:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788726008.267804:0:15749:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788726008.267809:0:15749:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b13be9acd28) has no exports 00000020:00000080:1.0:1788726008.267829:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788726008.267835:0:15749:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788726008.267837:0:15749:0:(genops.c:885:class_export_put()) final put ffff9b13be716800/OSS_uuid 00000020:00000080:1.0:1788726008.267840:0:15749:0:(genops.c:844:class_export_destroy()) destroying export ffff9b13be716800/OSS_uuid for OSS 00000020:01000000:1.0:1788726008.267844:0:15749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788726008.268171:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b13abd0d200:8425] 0 exiting: rc = 1 00000100:00100000:3.0:1788726008.268249:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b13bd670600:8426] 1 exiting: rc = 0 00000100:00100000:0.0:1788726008.268331:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b13be727600:8427] 2 exiting: rc = 0 00000100:00080000:2.0:1788726008.268402:0:6507:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788726008.268535:0:8716:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b12823a1200:8716] 3 exiting: rc = 0 00000100:00100000:1.0:1788726008.268664:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268676:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268681:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268687:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268693:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268697:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268702:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268707:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268712:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268717:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268722:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268728:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268733:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268738:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268744:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268749:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268754:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268759:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268764:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268770:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268775:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268781:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268797:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268802:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268806:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268810:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268814:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268819:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268824:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268829:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268834:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268838:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268842:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268847:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268851:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268856:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268861:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268865:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268870:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268874:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268879:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268883:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268888:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268892:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268897:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268901:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268907:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268911:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268916:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268919:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268924:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268942:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268946:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268951:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268955:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268960:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268964:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268976:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268982:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268987:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268991:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.268996:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.269002:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.269007:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.274818:0:11341:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b128311ca00:11341] 2 exiting: rc = 0 00000100:00100000:3.0:1788726008.277993:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b13bd672c00:8428] 0 exiting: rc = 1 00000100:00100000:2.0:1788726008.282515:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b13bd672a00:8429] 1 exiting: rc = 0 00000100:00100000:1.0:1788726008.282683:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282699:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282706:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282711:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282716:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282721:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282725:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282730:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282735:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.282740:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285705:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285722:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285728:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285734:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285739:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285744:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285749:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285754:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285759:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285764:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285769:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285773:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285777:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285783:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285788:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285793:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285797:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285803:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285824:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285830:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285835:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285840:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285845:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285850:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285855:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285860:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285864:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285869:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285874:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285879:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285884:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285889:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285894:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285899:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285904:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285909:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285913:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285917:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285922:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285939:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285945:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285950:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285956:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285960:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285965:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285969:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285975:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285980:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285985:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285990:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.285995:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.286001:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.286006:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.286026:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.287751:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b13851f2e00:8432] 2 exiting: rc = 0 00000100:00100000:0.0:1788726008.288385:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b138484e000:8430] 0 exiting: rc = 1 00000100:00100000:0.0:1788726008.288561:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b138484e800:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788726008.288625:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288633:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288639:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288657:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288664:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288669:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288674:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288679:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288684:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288690:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288704:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288711:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288717:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288722:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288728:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288733:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288738:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288744:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288750:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288756:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288761:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288766:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288772:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288777:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288783:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288803:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288808:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288813:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288818:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288823:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288827:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288833:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288838:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288843:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288862:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288868:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288873:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288878:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288883:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288888:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288893:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288898:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288904:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288909:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288915:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288920:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.288926:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289061:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289067:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289073:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289079:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289085:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289101:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289157:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289164:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289170:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289184:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289190:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289195:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289209:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289222:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289227:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289233:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.289245:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.294957:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b13ab2eba00:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1788726008.299554:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b13bd6fce00:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1788726008.299725:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299734:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299739:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299745:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299750:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299754:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299759:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299763:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299767:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299772:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299777:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299782:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299787:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299792:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299796:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299802:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299806:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299810:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299815:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299820:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299824:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299828:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299833:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299838:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299842:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299847:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299851:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299855:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299860:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299865:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299869:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299888:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299892:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299897:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299909:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299914:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299919:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299924:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299942:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299948:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299953:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299958:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299962:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299966:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299970:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299976:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299980:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299986:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299991:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.299996:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300002:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300007:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300018:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300026:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300031:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300045:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300051:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300056:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300061:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300066:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300070:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300074:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300079:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.300083:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788726008.301717:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b13be73d800:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1788726008.301808:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b139e456200:8436] 1 exiting: rc = 0 00000100:00100000:0.0:1788726008.301905:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301912:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301934:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301959:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301965:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301971:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301977:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301984:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301989:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.301995:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302001:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302008:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302013:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302019:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302025:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302055:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302062:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302068:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302075:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302084:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302089:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302094:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302099:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302104:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302109:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302144:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302151:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302171:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302178:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302183:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302188:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302194:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302200:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302205:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302210:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302216:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302221:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302234:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302240:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302257:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302264:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302270:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302276:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302281:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302286:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302292:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302298:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302304:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302310:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302316:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302323:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302343:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302350:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302355:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302360:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302365:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302371:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302376:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302381:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302387:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302393:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302398:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302405:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788726008.302411:0:15749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788726008.317481:0:15749:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788726028.311762:0:16513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788726038.299917:0:17112:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:1.0:1788726038.299924:0:17112:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788726038.299925:0:17112:0:(obd_mount.c:940:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788726038.300036:0:17112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b1283ea8000 00000020:01000004:1.0:1788726038.300927:0:17112:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788726038.300936:0:17112:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788726038.300953:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b13bd498000) 00000020:00000080:1.0:1788726038.300968:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788726038.394370:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788726038.395666:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788726038.398089:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788726038.398318:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788726038.398673:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788726038.398983:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788726038.399444:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788726038.399821:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788726038.400031:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788726038.400460:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.400813:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788726038.401021:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.401313:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788726038.401639:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788726038.402672:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.402951:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.403285:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.403482:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.403800:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.404035:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.404224:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.404420:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.404667:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.405083:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.405382:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.405666:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.406103:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.406439:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.406816:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.407223:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.407458:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.408148:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.408430:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.408710:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.409114:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.409435:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.410540:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.411168:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.411394:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.411667:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.411937:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.412141:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.412356:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.412678:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.412977:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788726038.413188:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788726038.413902:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.421347:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.421897:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.422072:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.422439:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.422683:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788726038.422938:0:17112:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1788726038.423967:0:17112:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788726038.424253:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788726038.424261:0:17112:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788726038.424273:0:17112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37f03 00000020:01000004:0.0:1788726038.424279:0:17112:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788726038.424284:0:17112:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788726038.424289:0:17112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b1283ea8000 from MGS 00000020:01000004:0.0:1788726038.424293:0:17112:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788726038.424303:0:17112:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b13be9ab370) 00000020:00000080:0.0:1788726038.424312:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788726038.424378:0:17112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283ea8000 from MGS, refs=2 00080000:01000000:0.0:1788726038.424383:0:17112:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788726038.424388:0:17112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37f11 00000100:00100000:0.0:1788726038.424483:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788726038.424603:0:17112:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788726038.424610:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788726038.425463:0:17112:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788726038.425472:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788726038.426228:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726038.426458:0:17112:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788726038.426464:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788726038.438656:0:17112:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788726038.438667:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788726038.439688:0:17112:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788726038.439697:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788726038.440429:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726038.440432:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726038.440434:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726038.440772:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726038.440781:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726038.440783:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726038.442036:0:17112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788726038.443643:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788726038.455102:0:17112:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788726038.466543:0:17125:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788726038.468108:0:17112:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788726038.468204:0:17112:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788726038.470855:0:17112:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788726038.473185:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726038.473350:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788726038.473356:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788726038.474232:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788726038.474240:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788726038.474961:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788726038.474968:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788726038.476020:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788726038.476045:0:17112:0:(obd_mount.c:422:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:2.0:1788726038.476047:0:17112:0:(obd_mount.c:431:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788726038.476074:0:17112:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:2.0:1788726038.476097:0:17112:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff9b128252b370) 00000020:00000080:2.0:1788726038.476113:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788726038.476228:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1385533000@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788726038.476671:0:17112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:2.0:1788726038.476678:0:17112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788726038.476804:0:17129:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788726038.483023:0:17131:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788726038.490936:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 9d482790-b071-43b8-b9fc-f5e087ab8e22) 00000020:00000080:0.0:1788726038.490966:0:17112:0:(genops.c:1385:class_connect()) connect: client 9d482790-b071-43b8-b9fc-f5e087ab8e22, cookie 0xa13c582691d37f1f 00000100:00080000:0.0:1788726038.490979:0:17112:0:(import.c:510:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788726038.490985:0:17112:0:(import.c:624:import_select_connection()) MGC192.168.203.112@tcp: import ffff9b1385533000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788726038.491019:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282599f80 x1875614791535360/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726038.491051:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9d482790-b071-43b8-b9fc-f5e087ab8e22->MGS 00000020:01000004:0.0:1788726038.491079:0:17112:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788726038.491094:0:17112:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788726038.491109:0:17112:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b13be9acd28) 00000020:00000080:0.0:1788726038.491563:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788726038.493568:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d482790-b071-43b8-b9fc-f5e087ab8e22:3637:1875614791535360:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788726038.493638:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726038.498860:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791535360 00000100:00100000:3.0:1788726038.498874:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791535360 00000100:00100000:3.0:1788726038.498930:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726038.498940:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1875614791535360:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788726038.498970:0:17126:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9d482790-b071-43b8-b9fc-f5e087ab8e22@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1788726038.499006:0:17126:0:(genops.c:1385:class_connect()) connect: client 9d482790-b071-43b8-b9fc-f5e087ab8e22, cookie 0xa13c582691d37f2d 00000100:00080000:3.0:1788726038.499717:0:17126:0:(import.c:65:import_set_state_nolock()) ffff9b1283c63800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726038.499807:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+5:3637:x1875614791535360:12345-0@lo:250:mount.lustre.0 Request processed in 866us (6167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.499815:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726038.500312:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788726038.500324:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1788726038.500332:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788726038.500336:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788726038.500340:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1385533000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788726038.500342:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788726038.500356:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788726038.500524:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9d482790-b071-43b8-b9fc-f5e087ab8e22:3637:1875614791535360:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788726038.505094:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726038.506585:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788726038.506593:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788726038.512587:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788726038.512599:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788726038.512983:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788726038.512990:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788726038.513794:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788726038.513981:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788726038.513987:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788726038.514646:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788726038.514653:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788726038.551694:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726038.551915:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788726038.551922:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788726038.553539:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788726038.553550:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788726038.554082:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726038.554565:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788726038.554570:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788726038.555584:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788726038.555594:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788726038.556475:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726038.556634:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788726038.556639:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788726038.557507:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788726038.557516:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788726038.558042:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726038.558510:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788726038.558516:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788726038.560470:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788726038.560484:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788726038.596012:0:17112:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726038.596365:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788726038.596373:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788726038.604958:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788726038.604981:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788726038.606529:0:17112:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788726038.606544:0:17112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788726038.619672:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788726038.619713:0:17112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788726038.619719:0:17112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788726038.619860:0:17112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788726038.619894:0:17112:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788726038.619899:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788726038.619901:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788726038.619902:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726038.619903:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726038.619904:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726038.619905:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726038.619907:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788726038.619908:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788726038.619910:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726038.619911:0:17112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788726038.619914:0:17112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788726038.619916:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788726038.619918:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788726038.619923:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726038.619925:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726038.619925:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726038.619926:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726038.619927:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788726038.619928:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788726038.619929:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726038.619930:0:17112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788726038.619955:0:17112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788726038.619975:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788726038.620047:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726038.620093:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13862d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.620272:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791535488 00000100:00100000:3.0:1788726038.620280:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791535488 00000100:00100000:3.0:1788726038.620324:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726038.620334:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+5:17112:x1875614791535488:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788726038.620379:0:17128:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788726038.620382:0:17128:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788726038.620385:0:17128:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788726038.639143:0:17149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788726038.639719:0:17128:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788726038.641760:0:17150:0:(mgs_llog.c:343:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788726038.641767:0:17150:0:(mgs_llog.c:343:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788726038.641770:0:17150:0:(mgs_llog.c:327:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788726038.641780:0:17150:0:(mgs_llog.c:327:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788726038.642266:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788726038.642500:0:17128:0:(mgs_llog.c:687:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788726038.642511:0:17128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788726038.644369:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+5:17112:x1875614791535488:12345-0@lo:253:mount.lustre.0 Request processed in 24019us (24304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.644390:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726038.644488:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788726038.644503:0:17112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788726038.644506:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788726038.644508:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788726038.644509:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726038.644510:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726038.644511:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726038.644513:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726038.644514:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788726038.644515:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788726038.644517:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726038.644518:0:17112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788726038.644535:0:17112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b1283ea8000 from lustre-MDT0000 10000000:01000000:1.0:1788726038.644561:0:17112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788726038.644564:0:17112:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788726038.644567:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b128252b370 10000000:01000000:1.0:1788726038.644571:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788726038.644579:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9b128252b370 from 1 10000000:01000000:1.0:1788726038.644581:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788726038.644615:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726038.644626:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726038.644641:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726038.644660:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726038.644695:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726038.644731:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13862d3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.644892:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791535616 00000100:00100000:3.0:1788726038.644899:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791535616 00000100:00100000:3.0:1788726038.644944:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788726038.644953:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+5:17112:x1875614791535616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726038.644965:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726038.644979:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8f600/0xa13c582691d37f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37f34 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.645002:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8f600/0xa13c582691d37f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37f34 expref: 6 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.645012:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8f600/0xa13c582691d37f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37f34 expref: 6 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.645021:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f600, rc 0) 00000100:00100000:3.0:1788726038.645063:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+6:17112:x1875614791535616:12345-0@lo:101:mount.lustre.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.645068:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726038.645255:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726038.645268:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.645276:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726038.645330:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726038.645358:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.645388:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726038.645497:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791535744 00000100:00100000:1.0:1788726038.645500:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791535744 00000100:00100000:1.0:1788726038.645533:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726038.645540:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+6:17112:x1875614791535744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726038.645611:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+6:17112:x1875614791535744:12345-0@lo:501:mount.lustre.0 Request processed in 71us (251us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788726038.645618:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788726038.645689:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535744:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788726038.645716:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788726038.645736:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.645743:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726038.645762:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b1283ea8000 10000000:01000000:0.0:1788726038.645767:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788726038.645771:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b1283ea8000 10000000:01000000:0.0:1788726038.645773:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788726038.645776:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b1283ea8000 from 1 10000000:01000000:0.0:1788726038.645778:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788726038.645807:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.645814:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.645821:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.645843:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726038.645872:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.645891:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 11 seconds 00000100:00100000:2.0:1788726038.646049:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791535872 00000100:00100000:2.0:1788726038.646054:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791535872 00000100:00100000:2.0:1788726038.646073:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788726038.646079:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+6:17112:x1875614791535872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726038.646087:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726038.646097:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13be9a6600/0xa13c582691d37f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37f42 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.646111:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13be9a6600/0xa13c582691d37f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37f42 expref: 7 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.646146:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13be9a6600/0xa13c582691d37f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37f42 expref: 7 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.646153:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a6600, rc 0) 00000100:00100000:2.0:1788726038.646187:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+7:17112:x1875614791535872:12345-0@lo:101:mount.lustre.0 Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726038.646202:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726038.646392:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791535872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.646404:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f49 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.646412:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37f49 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726038.646425:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788726038.646438:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f49 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.646452:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8c00/0xa13c582691d37f42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f49 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726038.646459:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788726038.646462:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788726038.646467:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b1283ea8000 10000000:01000000:0.0:1788726038.646469:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788726038.646472:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788726038.646474:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788726038.646489:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.646496:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.646502:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.646515:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726038.646542:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.646568:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.646648:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536000 00000100:00100000:3.0:1788726038.646652:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536000 00000100:00100000:3.0:1788726038.646685:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788726038.646692:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+7:17112:x1875614791536000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726038.646699:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726038.646706:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8fe00/0xa13c582691d37f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37f50 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.646720:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8fe00/0xa13c582691d37f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37f50 expref: 8 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.646738:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8fe00/0xa13c582691d37f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37f50 expref: 8 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.646744:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8fe00, rc 0) 00000100:00100000:3.0:1788726038.646791:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+8:17112:x1875614791536000:12345-0@lo:101:mount.lustre.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.646798:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726038.647000:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.647011:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f57 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.647020:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37f57 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.647077:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726038.647101:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.647148:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.647315:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536128 00000100:00100000:3.0:1788726038.647319:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536128 00000100:00100000:3.0:1788726038.647350:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788726038.647365:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+8:17112:x1875614791536128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726038.647486:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17112:x1875614791536128:12345-0@lo:501:mount.lustre.0 Request processed in 129us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.647493:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726038.647605:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726038.647632:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.647670:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.647700:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 11 seconds 00000100:00100000:1.0:1788726038.647749:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536256 00000100:00100000:1.0:1788726038.647754:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536256 00000100:00100000:1.0:1788726038.647793:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788726038.647802:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17112:x1875614791536256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726038.648728:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17112:x1875614791536256:12345-0@lo:503:mount.lustre.0 Request processed in 924us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726038.648736:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788726038.648895:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791536256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.649260:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17151:1875614791536384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726038.649303:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.649338:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726038.649391:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536384 00000100:00100000:2.0:1788726038.649396:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536384 00000100:00100000:2.0:1788726038.649434:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726038.649442:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17151:x1875614791536384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726038.650255:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17151:1875614791536384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788726038.650283:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.650294:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.650296:0:17151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788726038.650302:0:17151:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788726038.650311:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726038.650326:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b13bd4999b8) 00000020:00000080:1.0:1788726038.650340:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788726038.650345:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788726038.650430:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17151:x1875614791536384:12345-0@lo:502:llog_process_th.0 Request processed in 673us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726038.650440:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00080000:01000000:1.0:1788726038.650633:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788726038.650640:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37f65 00000020:00000080:1.0:1788726038.652726:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788726038.652738:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726038.652745:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.652747:0:17151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788726038.652750:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.652755:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.652756:0:17151:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788726038.652760:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726038.652775:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b13bd49cd28) 00000020:00000080:1.0:1788726038.652791:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788726038.652795:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788726038.652797:0:17151:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788726038.652799:0:17151:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788726038.652806:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788726038.652880:0:17151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283ea8000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788726038.652891:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b13bd49b370) 00000020:00000080:1.0:1788726038.652899:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788726038.652977:0:17151:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788726038.652983:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d37f7a 00000020:00000080:1.0:1788726038.653082:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788726038.653088:0:17151:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788726038.653093:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa13c582691d37f81 00080000:01000000:1.0:1788726038.653098:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788726038.653103:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37f88 00010000:00010000:0.0:1788726038.802156:0:17151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788726038.804336:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788726038.805926:0:17151:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788726038.807177:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b13be9a8000) 00000020:00000080:0.0:1788726038.807200:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788726038.807274:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788726038.807282:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37f96 00000020:00000080:0.0:1788726038.809693:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788726038.823280:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa13c582691d37f9d 00000020:00000080:0.0:1788726038.823972:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788726038.823985:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.823993:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.823995:0:17151:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788726038.823999:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788726038.824002:0:17151:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788726038.824011:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726038.824014:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726038.824016:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788726038.824018:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.824020:0:17151:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788726038.824022:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726038.824027:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.824028:0:17151:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788726038.824033:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788726038.824076:0:17151:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788726038.824093:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.824097:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.824099:0:17151:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788726038.824102:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726038.824105:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.824106:0:17151:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788726038.824108:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788726038.824143:0:17151:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:0.0:1788726038.824172:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788726038.824187:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9b13be9a99b8) 00000020:00000080:0.0:1788726038.824203:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788726038.824208:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788726038.829286:0:17151:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788726038.829297:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788726038.829310:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37fab 00010000:00080000:2.0:1788726038.829348:0:17151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13af851800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788726038.835298:0:17151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788726038.837847:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788726038.837863:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788726038.837904:0:17151:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788726038.837929:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d37fb2 00000100:00080000:0.0:1788726038.837940:0:17151:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788726038.837946:0:17151:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788726038.837985:0:17151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598700 x1875614791536512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726038.838018:0:17151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788726038.838096:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.838109:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.838111:0:17151:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788726038.838137:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788726038.838141:0:17151:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788726038.838143:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726038.838144:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726038.838146:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788726038.838150:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.838151:0:17151:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788726038.838154:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788726038.838159:0:17151:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788726038.838161:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.838163:0:17151:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788726038.838166:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788726038.838170:0:17151:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:0.0:1788726038.838194:0:17151:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788726038.838197:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788726038.838210:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b139e433370) 00000020:00000080:0.0:1788726038.838223:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788726038.838227:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788726038.838283:0:17151:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788726038.838290:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788726038.838296:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37fc0 00010000:00080000:0.0:1788726038.838330:0:17151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13968fc800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00100000:2.0:1788726038.838897:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726038.838960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726038.839229:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536512 00000100:00100000:3.0:1788726038.839237:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536512 00000100:00100000:3.0:1788726038.839265:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726038.839273:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791536512:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788726038.839289:0:17138:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788726038.840099:0:17151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788726038.841638:0:17151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788726038.841877:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788726038.845970:0:17151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788726038.846443:0:17151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788726038.846748:0:17151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788726038.847959:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788726038.847965:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788726038.854643:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788726038.854659:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788726038.854707:0:17151:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788726038.854727:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d37fc7 00000100:00080000:2.0:1788726038.854738:0:17151:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726038.854743:0:17151:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b13968fc800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726038.854781:0:17151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387635180 x1875614791536640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726038.854824:0:17151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788726038.854949:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536640:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788726038.854964:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726038.854968:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726038.854969:0:17151:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788726038.854972:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788726038.854974:0:17151:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788726038.854976:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726038.854978:0:17151:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726038.854979:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788726038.854981:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726038.854982:0:17151:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788726038.854984:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788726038.854988:0:17151:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788726038.854991:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726038.854992:0:17151:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788726038.854994:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788726038.854998:0:17151:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000400:00000100:0.0:1788726038.855000:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791536640 offset 0 length 520: 4 00000020:01000000:2.0:1788726038.855025:0:17151:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788726038.855028:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726038.855040:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b12825299b8) 00000020:00000080:2.0:1788726038.855051:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788726038.855055:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788726038.855161:0:17151:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788726038.855167:0:17151:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788726038.855174:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa13c582691d37fd5 00010000:00080000:2.0:1788726038.855204:0:17151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1390daa000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788726038.855415:0:17151:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788726038.855485:0:17151:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788726038.855500:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1788726038.855915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788726038.855924:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788726038.856306:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726038.856318:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791536768:0@lo:400:kworker.0 00000100:00100000:2.0:1788726038.856368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726038.859977:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791536768 00000100:00100000:1.0:1788726038.859989:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791536768 00000100:00100000:1.0:1788726038.860098:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788726038.860109:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:3638:x1875614791536768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726038.860306:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:3638:x1875614791536768:12345-0@lo:400:kworker.0 Request processed in 199us (3936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726038.860314:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726038.860416:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791536768:0@lo:400:kworker.0 00000040:00080000:0.0:1788726038.860574:0:17151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726038.862067:0:17151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788726038.862274:0:17151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788726038.863384:0:17159:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788726038.863395:0:17159:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788726038.867284:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788726038.867300:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788726038.867345:0:17151:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788726038.867365:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d37fdc 00000100:00080000:0.0:1788726038.867376:0:17151:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788726038.867382:0:17151:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b1390daa000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788726038.867430:0:17151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282598380 x1875614791536896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726038.867450:0:17151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788726038.867499:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.867504:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.867506:0:17151:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788726038.867509:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726038.867513:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.867514:0:17151:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788726038.867516:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788726038.867518:0:17151:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788726038.867520:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.867522:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.867523:0:17151:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788726038.867525:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726038.867527:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.867528:0:17151:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788726038.867531:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788726038.867563:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17151:1875614791537024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726038.867637:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.867673:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788726038.867987:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536896:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788726038.868018:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791536896 offset 0 length 520: 4 00000100:00100000:2.0:1788726038.868050:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537024 00000100:00100000:2.0:1788726038.868057:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537024 00000100:00100000:2.0:1788726038.868103:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788726038.868112:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17151:x1875614791537024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726038.868813:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17151:x1875614791537024:12345-0@lo:502:llog_process_th.0 Request processed in 698us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726038.868821:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788726038.868963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788726038.868978:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788726038.869490:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17151:1875614791537024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788726038.869532:0:17151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.869545:0:17151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.869548:0:17151:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788726038.869552:0:17151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788726038.870264:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788726038.870289:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788726038.870303:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f57 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.870313:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8200/0xa13c582691d37f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f57 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726038.870321:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b1283ea8000 from 1 10000000:01000000:2.0:1788726038.870324:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788726038.870357:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.870366:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.870376:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726038.870418:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726038.870469:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.870508:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.874183:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537152 00000100:00100000:0.0:1788726038.874195:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537152 00000100:00100000:0.0:1788726038.874249:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788726038.874260:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+9:17112:x1875614791537152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.874276:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726038.874299:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37fe3 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.874322:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 10 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.874331:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 10 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.874340:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9600, rc 0) 00000100:00100000:0.0:1788726038.874419:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+10:17112:x1875614791537152:12345-0@lo:101:mount.lustre.0 Request processed in 162us (3950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.874426:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726038.874517:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726038.874536:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.874546:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726038.875262:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788726038.875309:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726038.875333:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791536512:12345-0@lo:38:llog_process_th.0 Request processed in 36059us (36372us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788726038.875343:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726038.875345:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5e40 going to sleep for 11 seconds 00000100:00080000:2.0:1788726038.875372:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726038.875378:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788726038.875381:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788726038.875462:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537280 00000100:00100000:0.0:1788726038.875468:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537280 00000100:00100000:0.0:1788726038.875496:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788726038.875520:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+10:17112:x1875614791537280:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788726038.875536:0:17128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788726038.875542:0:17128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788726038.875614:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+10:17112:x1875614791537280:12345-0@lo:256:mount.lustre.0 Request processed in 110us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.875630:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788726038.877023:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537280:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788726038.879098:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788726038.879129:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.879151:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726038.879160:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1283ea8000 from 1 10000000:01000000:2.0:1788726038.886333:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788726038.886384:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.886396:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726038.887336:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726038.887366:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726038.887555:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.887604:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.887614:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537408 00000100:00100000:0.0:1788726038.887622:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537408 00000100:00100000:0.0:1788726038.887674:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726038.887685:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+10:17112:x1875614791537408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.887697:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726038.887712:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37ff1 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.887733:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 11 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.887743:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 11 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.887752:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8e00, rc 0) 00000100:00100000:0.0:1788726038.887884:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791537408:12345-0@lo:101:mount.lustre.0 Request processed in 199us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.887891:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726038.887970:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726038.887986:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.888008:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726038.888070:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726038.888098:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726038.888277:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.895052:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537536 00000100:00100000:0.0:1788726038.895067:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537536 00000100:00100000:0.0:1788726038.895201:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726038.895213:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791537536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726038.896981:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791537536:12345-0@lo:501:mount.lustre.0 Request processed in 1761us (8872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.896995:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788726038.898341:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726038.898516:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726038.898586:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.898629:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12834a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.898728:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537664 00000100:00100000:0.0:1788726038.898743:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537664 00000100:00100000:0.0:1788726038.898802:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788726038.898812:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791537664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.898940:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791537664:12345-0@lo:503:mount.lustre.0 Request processed in 129us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.898948:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788726038.900346:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791537664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726038.900962:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17161:1875614791537792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726038.901015:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726038.901054:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.901112:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537792 00000100:00100000:3.0:1788726038.901147:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537792 00000100:00100000:3.0:1788726038.901184:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788726038.901193:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17161:x1875614791537792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726038.901780:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17161:x1875614791537792:12345-0@lo:502:llog_process_th.0 Request processed in 587us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726038.901909:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17161:1875614791537792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788726038.901934:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.901943:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.901945:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788726038.901952:0:17161:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1283ea8000 00000020:00000080:1.0:1788726038.901955:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788726038.901963:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726038.901965:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.901967:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788726038.901969:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.901972:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.901973:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788726038.901977:0:17161:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1283ea8000 00000020:00000080:1.0:1788726038.901979:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788726038.902047:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726038.902050:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.902052:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788726038.902054:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.902057:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.902058:0:17161:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788726038.902061:0:17161:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1283ea8000 00000020:00000080:1.0:1788726038.902063:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788726038.902080:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726038.902084:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.902085:0:17161:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788726038.902087:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726038.902089:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726038.902091:0:17161:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788726038.902094:0:17161:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1283ea8000 00000020:00000080:1.0:1788726038.902096:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788726038.902145:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17161:1875614791537920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788726038.902181:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726038.902208:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be99b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.902246:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791537920 00000100:00100000:0.0:1788726038.902251:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791537920 00000100:00100000:3.0:1788726038.902259:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788726038.902291:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788726038.902298:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17161:x1875614791537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788726038.902514:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17161:x1875614791537920:12345-0@lo:502:llog_process_th.0 Request processed in 215us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.902522:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788726038.916909:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17161:1875614791537920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788726038.916953:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726038.916960:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726038.916963:0:17161:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788726038.916966:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788726038.917169:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788726038.917192:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726038.917209:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917220:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726038.917280:0:17112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788726038.917284:0:17112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b1283ea8000 10000000:01000000:0.0:1788726038.917287:0:17112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b1283ea8000 10000000:01000000:0.0:1788726038.917291:0:17112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788726038.917296:0:17112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b1283ea8000 from 1 10000000:01000000:0.0:1788726038.917299:0:17112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788726038.917332:0:17112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917351:0:17112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917361:0:17112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.917381:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726038.917612:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.917644:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.917669:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538048 00000100:00100000:0.0:1788726038.917674:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538048 00000100:00100000:0.0:1788726038.917709:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788726038.917717:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17112:x1875614791538048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.917729:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726038.917739:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a8000/0xa13c582691d38006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d37fff expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917759:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a8000/0xa13c582691d38006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d37fff expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917769:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a8000/0xa13c582691d38006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37fff expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917777:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8000, rc 0) 00000100:00100000:0.0:1788726038.917810:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791538048:12345-0@lo:101:mount.lustre.0 Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.917817:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788726038.917876:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726038.917889:0:17112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38006 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.917897:0:17112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38006 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.917943:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726038.917967:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.917991:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.918191:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538176 00000100:00100000:3.0:1788726038.918196:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538176 00000100:00100000:3.0:1788726038.918225:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788726038.918233:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791538176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726038.918337:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791538176:12345-0@lo:501:mount.lustre.0 Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.918343:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788726038.919628:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726038.919676:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.919730:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.919760:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.919774:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538304 00000100:00100000:0.0:1788726038.919779:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538304 00000100:00100000:0.0:1788726038.919813:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726038.919821:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791538304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.919928:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791538304:12345-0@lo:503:mount.lustre.0 Request processed in 107us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.919936:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726038.919979:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791538304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726038.920189:0:17166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726038.920224:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.920245:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538432 00000100:00100000:0.0:1788726038.920265:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538432 00000100:00100000:0.0:1788726038.920290:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788726038.920296:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726038.920371:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538432:12345-0@lo:502:llog_process_th.0 Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.920378:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726038.931609:0:17166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138769eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726038.931652:0:17166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538432:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788726038.931726:0:17166:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788726038.931740:0:17166:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b128252cd28) 00000020:00000080:2.0:1788726038.931757:0:17166:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788726038.933108:0:17166:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283ea8000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788726038.933129:0:17166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1283ea8000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788726038.933133:0:17166:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1283ea8000 4 00010000:00080000:2.0:1788726038.933169:0:17166:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13842d9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788726038.940711:0:17166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788726038.952625:0:17166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788726038.952671:0:17166:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788726038.952684:0:17166:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa13c582691d38014 00000100:00080000:2.0:1788726038.952695:0:17166:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726038.952700:0:17166:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b13842d9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726038.952735:0:17166:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387636300 x1875614791538560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788726038.952769:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791538560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726038.952852:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.952923:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538560 00000100:00100000:2.0:1788726038.952930:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538560 00000100:00100000:2.0:1788726038.952959:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726038.952966:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791538560:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726038.953017:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791538560:12345-0@lo:38:llog_process_th.0 Request processed in 50us (165us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788726038.953024:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726038.953058:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788726038.953065:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726038.953234:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788726038.953239:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791538560:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788726038.953437:0:17166:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788726038.953866:0:17166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726038.953917:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.953940:0:17166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7e40 going to sleep for 11 seconds 00000100:00080000:0.0:1788726038.954060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788726038.954065:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788726038.954067:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788726038.954071:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788726038.954075:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788726038.954079:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788726038.954111:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128259a300 x1875614791538816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726038.954163:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538688 00000100:00100000:0.0:1788726038.954167:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538688 00000100:00100000:0.0:1788726038.954202:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788726038.954209:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726038.954728:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791538816:0@lo:38:kworker.0 00000100:00100000:2.0:1788726038.954762:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.955003:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538688:12345-0@lo:502:llog_process_th.0 Request processed in 793us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.955011:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788726038.955213:0:17166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726038.955259:0:17166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788726038.955294:0:17166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.955953:0:17166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726038.957250:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538816 00000100:00100000:3.0:1788726038.957261:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538816 00000100:00100000:3.0:1788726038.957296:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726038.957303:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791538816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788726038.957322:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788726038.957494:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791538816:12345-0@lo:38:kworker.0 Request processed in 189us (2730us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788726038.957502:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726038.958957:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791538944 00000100:00100000:0.0:1788726038.958966:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791538944 00000100:00100000:0.0:1788726038.959009:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788726038.959018:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788726038.959169:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17166:x1875614791538944:12345-0@lo:502:llog_process_th.0 Request processed in 152us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.959181:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788726038.960222:0:17166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9d482790-b071-43b8-b9fc-f5e087ab8e22:17166:1875614791538944:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788726038.960256:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788726038.960614:0:17112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788726038.960634:0:17112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788726038.960648:0:17112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38006 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.960659:0:17112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9800/0xa13c582691d37fff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38006 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788726038.960701:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788726038.960703:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726038.960704:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726038.960705:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726038.960706:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726038.960708:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726038.960709:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726038.960710:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726038.960712:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726038.960713:0:17112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788726038.960717:0:17112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788726038.960719:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788726038.960720:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788726038.960721:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726038.960722:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726038.960723:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726038.960724:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726038.960725:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788726038.960726:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788726038.960727:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726038.960728:0:17112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788726038.960747:0:17112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788726038.960762:0:17112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791539072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788726038.960887:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726038.960916:0:17112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13af83fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.960949:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539072 00000100:00100000:0.0:1788726038.960954:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539072 00000100:00100000:0.0:1788726038.960988:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788726038.960995:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791539072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788726038.961019:0:17127:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788726038.961031:0:17127:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1788726038.961368:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726038.961374:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788726038.961377:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791538816:0@lo:38:kworker.0 20000000:01000000:3.0:1788726038.972869:0:17127:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788726038.972883:0:17127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788726038.972898:0:17149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788726038.972902:0:17149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788726038.972926:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.972945:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.972953:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.972992:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.973006:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726038.973020:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791539200:0@lo:104: 00000100:00100000:3.0:1788726038.973107:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726038.975247:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17112:x1875614791539072:12345-0@lo:253:mount.lustre.0 Request processed in 14244us (14352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726038.975262:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788726038.975587:0:17112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17112:1875614791539072:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788726038.975604:0:17112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788726038.975607:0:17112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788726038.975609:0:17112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788726038.975610:0:17112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726038.975611:0:17112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726038.975612:0:17112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726038.975613:0:17112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726038.975615:0:17112:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788726038.975616:0:17112:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788726038.975618:0:17112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726038.975620:0:17112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788726038.975635:0:17112:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788726038.977955:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e592b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726038.978034:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539200 00000100:00100000:0.0:1788726038.978044:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539200 00000100:00100000:0.0:1788726038.978106:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726038.978138:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791539200:12345-0@lo:104: 00010000:00010000:0.0:1788726038.978154:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978228:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788726038.978234:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791539200:12345-0@lo:104: Request processed in 120us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726038.978241:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788726038.978277:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791539200:0@lo:104: 00010000:00010000:0.0:1788726038.978298:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978315:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726038.978320:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978327:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788726038.978331:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978446:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726038.978456:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726038.978462:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788726038.978496:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978503:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726038.978523:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978531:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6400/0xa13c582691d37fe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37fea expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.978545:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726038.978547:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726038.978549:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726038.978582:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791539328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726038.978617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726038.978751:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539328 00000100:00100000:3.0:1788726038.978756:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539328 00010000:00010000:3.0:1788726038.978774:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726038.978809:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726038.978816:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3640:x1875614791539328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726038.978825:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726038.978840:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978849:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978861:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13af8a9600/0xa13c582691d37fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d37fe3 expref: 12 pid: 17127 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978873:0:17118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978881:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788726038.978895:0:17118:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005992905s 00010000:00010000:3.0:1788726038.978899:0:17118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978905:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978922:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978929:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978934:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726038.978938:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978944:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978956:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726038.978966:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726038.978998:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:3640:x1875614791539328:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726038.979005:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788726038.979424:0:17149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.979434:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726038.979442:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1384c8e600/0xa13c582691d3801b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726038.979481:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791539328:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788726038.993454:0:17112:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788726038.995108:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788726038.995882:0:17174:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788726038.996343:0:17174:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788726038.997973:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788726038.999464:0:17175:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9b128259b800 x1875614791539456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726038.999477:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00000040:01000000:3.0:1788726039.000025:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788726039.000066:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788726039.001277:0:17112:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788726039.001291:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788726039.001349:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726039.002985:0:17174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788726039.003052:0:17174:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000020:00080000:2.0:1788726039.003273:0:17173:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788726039.003278:0:17173:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788726039.003985:0:17112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788726039.004923:0:17112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788726039.004982:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788726039.007010:0:17112:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788726039.009621:0:17112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788726039.011962:0:17112:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788726039.012005:0:17112:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf8241a27988 00100000:10000000:3.0:1788726039.012013:0:17112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788726039.013008:0:17112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788726039.013025:0:17112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788726039.013044:0:17112:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788726039.013062:0:17112:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788726039.014266:0:17112:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788726039.018003:0:17112:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788726039.485598:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726039.998699:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788726039.998816:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788726039.998830:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b1283ea8000 from 7 10000000:01000000:0.0:1788726039.998833:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788726039.998875:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726039.998887:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726039.998898:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726039.998924:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791539584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726039.998986:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726039.999038:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726039.999088:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539584 00000100:00100000:3.0:1788726039.999094:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539584 00000100:00100000:3.0:1788726039.999164:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788726039.999174:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+11:17131:x1875614791539584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726039.999187:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726039.999199:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38022 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726039.999219:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38022 expref: 12 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726039.999228:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38022 expref: 12 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726039.999238:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f400, rc 0) 00000100:00100000:3.0:1788726039.999279:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17131:x1875614791539584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726039.999285:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788726039.999327:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791539584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726039.999351:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726039.999360:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726039.999406:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791539712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788726039.999435:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726039.999450:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138643a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788726039.999463:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539712 00000100:00100000:3.0:1788726039.999467:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539712 00000100:00100000:3.0:1788726039.999488:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788726039.999494:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17131:x1875614791539712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788726039.999509:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788726039.999524:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788726039.999527:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788726039.999597:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17131:x1875614791539712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726039.999605:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788726039.999634:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791539712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788726039.999670:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788726039.999677:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726039.999684:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726040.059260:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:2.0:1788726040.515480:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726041.020786:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788726041.083391:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:3.0:1788726041.537434:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726042.107309:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:2.0:1788726042.566486:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726043.132245:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726043.579952:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788726043.660537:0:17418:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788726044.157188:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00000100:00080000:1.0:1788726044.284106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788726044.284113:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788726044.284158:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726044.284167:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:1.0:1788726044.284172:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788726044.284179:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726044.284201:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283759500 x1875614791539968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726044.284218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726044.284222:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726044.284225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726044.284227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726044.284230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788726044.284233:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788726044.284235:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13842d9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726044.284239:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b13842d9000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726044.284251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283759f80 x1875614791540096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726044.284331:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791539840:0@lo:400:kworker.0 00000100:00100000:0.0:1788726044.284414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726044.284532:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539840 00000100:00100000:1.0:1788726044.284547:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539840 00000100:00100000:1.0:1788726044.284599:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726044.284609:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3641:x1875614791539840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726044.284661:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3641:x1875614791539840:12345-0@lo:400:kworker.0 Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726044.284668:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726044.284711:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791539840:0@lo:400:kworker.0 00000100:00100000:2.0:1788726044.284900:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791539968:0@lo:38:kworker.0 00000100:00100000:2.0:1788726044.284930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726044.284958:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791540096:0@lo:38:kworker.0 00000100:00100000:2.0:1788726044.284979:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726044.285481:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540096 00000100:00100000:1.0:1788726044.285487:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540096 00000100:00100000:1.0:1788726044.285514:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726044.285520:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791540096:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788726044.285540:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1788726044.285569:0:17135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa13c582691d38030 00000004:00100000:1.0:1788726044.285583:0:17135:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788726044.285718:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b1392b2c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726044.285765:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875614791540096:12345-0@lo:38:kworker.0 Request processed in 244us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726044.285771:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726044.285863:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539968 00000100:00100000:0.0:1788726044.285868:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539968 00000100:00100000:0.0:1788726044.285897:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726044.285903:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791539968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788726044.285914:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788726044.289162:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b1283759f80 x1875614791540096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788726044.289183:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788726044.289192:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788726044.289197:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788726044.289200:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788726044.289207:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875614791540096:0@lo:38:kworker.0 00000100:00100000:2.0:1788726044.324616:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791539968:12345-0@lo:38:kworker.0 Request processed in 38703us (39676us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788726044.324634:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788726044.324802:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726044.324808:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788726044.324812:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791539968:0@lo:38:kworker.0 00000020:00000004:1.0:1788726044.548837:0:17470:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788726044.549036:0:17470:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788726044.606174:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726045.180878:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00000020:00000004:0.0:1788726045.525850:0:17520:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788726045.526038:0:17520:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788726045.634907:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726046.203274:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726046.655906:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726047.227239:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726047.683029:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726048.267016:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00000100:00100000:0.0:1788726048.381513:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726038/real 1788726038] req@ffff9b1282598380 x1875614791536896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726048.381559:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b1282598380 x1875614791536896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726048.381572:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726038/real 1788726038] req@ffff9b1387635180 x1875614791536640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726048.381586:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b1387635180 x1875614791536640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726048.381607:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726048.381659:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788726048.381664:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788726048.381671:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726048.381677:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788726048.381680:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791536640:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788726048.382009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788726048.382015:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788726048.382018:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726048.382024:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:3.0:1788726048.382030:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788726048.382037:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726048.382064:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346dc00 x1875614791540352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726048.382083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726048.382086:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788726048.382088:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726048.382091:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1788726048.382095:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788726048.382098:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b13968fc800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726048.382111:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346ce00 x1875614791540480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726048.382445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726048.382449:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788726048.382451:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726048.382455:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1788726048.382459:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788726048.382463:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b1390daa000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726048.382489:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128346ed80 x1875614791540608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788726048.382533:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540352:0@lo:38:kworker.0 00000100:00100000:3.0:1788726048.382630:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726048.382698:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540480:0@lo:8:kworker.0 00000400:00000100:3.0:1788726048.382722:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791540480 offset 0 length 520: 4 00000100:00100000:3.0:1788726048.382742:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540608:0@lo:8:kworker.0 00000400:00000100:3.0:1788726048.382762:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791540608 offset 0 length 520: 4 00000100:00100000:2.0:1788726048.382903:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791540224:0@lo:400:kworker.0 00000100:00100000:2.0:1788726048.382944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726048.382978:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726048.382983:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791540736:0@lo:400:kworker.0 00000100:00100000:2.0:1788726048.383013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726048.383057:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540736 00000100:00100000:2.0:1788726048.383066:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540736 00000100:00100000:2.0:1788726048.383135:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726048.383444:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726048.383507:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791540736:12345-0@lo:400:kworker.0 Request processed in 362us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726048.383515:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788726048.383559:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b128346d880 x1875614791540736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726048.383573:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791540736:0@lo:400:kworker.0 00000100:00100000:1.0:1788726048.383687:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540352 00000100:00100000:1.0:1788726048.383693:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540352 00000100:00100000:1.0:1788726048.383719:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726048.383726:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791540352:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788726048.383745:0:17138:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788726048.386936:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540224 00000100:00100000:3.0:1788726048.386957:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540224 00000100:00100000:3.0:1788726048.387043:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788726048.387055:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3638:x1875614791540224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726048.387198:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3638:x1875614791540224:12345-0@lo:400:kworker.0 Request processed in 145us (4252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726048.387205:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788726048.389296:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791540224:0@lo:400:kworker.0 00000100:00100000:1.0:1788726048.419699:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791540352:12345-0@lo:38:kworker.0 Request processed in 35957us (37053us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788726048.419720:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788726048.419778:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726048.419786:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788726048.419790:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540352:0@lo:38:kworker.0 00010000:00010000:0.0:1788726048.699324:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726049.278939:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726049.727556:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726050.299337:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726050.748569:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726051.261352:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788726051.324783:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726051.775466:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726052.349620:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726052.803526:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726053.374998:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00000020:01000004:0.0:1788726053.484107:0:17865:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:0.0:1788726053.484112:0:17865:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788726053.484114:0:17865:0:(obd_mount.c:940:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788726053.484487:0:17865:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b139e73e000 00000020:01000004:0.0:1788726053.484562:0:17865:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788726053.484574:0:17865:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788726053.484586:0:17865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9b139e430000) 00000020:00000080:0.0:1788726053.484601:0:17865:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00080000:2.0:1788726053.502650:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788726053.502658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788726053.502661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726053.502669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1788726053.502674:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788726053.502680:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726053.502840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387635f80 x1875614791540992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726053.502861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726053.502865:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726053.502868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726053.502871:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788726053.503209:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540992:0@lo:38:kworker.0 00000100:00100000:2.0:1788726053.503280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.503325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791541120:0@lo:400:kworker.0 00000100:00100000:2.0:1788726053.503348:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540992 00000100:00100000:2.0:1788726053.503355:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540992 00000100:00100000:1.0:1788726053.503362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.503382:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788726053.503388:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726053.503388:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791540864:0@lo:400:kworker.0 00000100:00100000:2.0:1788726053.503395:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791540992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788726053.503412:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788726053.503413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.503444:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791540864 00000100:00100000:1.0:1788726053.503447:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791540864 00000100:00100000:1.0:1788726053.503476:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788726053.503482:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3641:x1875614791540864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.503537:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:3641:x1875614791540864:12345-0@lo:400:kworker.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.503544:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788726053.503629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791540864:0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.514284:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541120 00000100:00100000:1.0:1788726053.514298:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541120 00000100:00100000:1.0:1788726053.514358:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726053.514368:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791541120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.514454:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791541120:12345-0@lo:400:kworker.0 Request processed in 88us (11090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.514462:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788726053.514515:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b1387636d80 x1875614791541120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726053.514548:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791541120:0@lo:400:kworker.0 00000100:00100000:3.0:1788726053.528657:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791540992:12345-0@lo:38:kworker.0 Request processed in 25254us (25370us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788726053.528671:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788726053.529107:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726053.529113:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788726053.529160:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540992:0@lo:38:kworker.0 00100000:10000000:3.0:1788726053.583749:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788726053.584772:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788726053.591079:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.591918:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.592290:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.592529:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.592789:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.593381:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.595754:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.597556:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.598160:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.598678:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.598981:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788726053.599244:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788726053.603499:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.603839:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788726053.604244:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.604523:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788726053.604785:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788726053.605046:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.605567:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.605845:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.606468:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788726053.606671:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788726053.606990:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.607471:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.607670:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.607961:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.608114:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.608336:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.608489:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.608689:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.609001:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.609215:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.609413:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.609565:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.609824:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.610178:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.610374:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.610527:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.610809:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.611048:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.611244:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.611600:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788726053.611840:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788726053.612165:0:17865:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00080000:01000000:2.0:1788726053.612817:0:17865:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788726053.613104:0:17865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788726053.613115:0:17865:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788726053.613298:0:17865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d3803e 00000020:01000004:2.0:1788726053.613305:0:17865:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788726053.613327:0:17865:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788726053.613331:0:17865:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788726053.613336:0:17865:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788726053.613371:0:17865:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788726053.613376:0:17865:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788726053.617599:0:17865:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788726053.617637:0:17865:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788726053.617642:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788726053.617643:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.617644:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.617645:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.617651:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.617652:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.617653:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.617655:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.617656:0:17865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788726053.617659:0:17865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788726053.617661:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788726053.617662:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.617663:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.617664:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.617665:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.617666:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.617667:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.617667:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.617668:0:17865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788726053.617693:0:17865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788726053.617785:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788726053.617851:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.618040:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788726053.618339:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541248 00000100:00100000:1.0:1788726053.618347:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541248 00000100:00100000:1.0:1788726053.618433:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788726053.618443:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17865:x1875614791541248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788726053.618474:0:17127:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788726053.618477:0:17127:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788726053.618483:0:17127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788726053.618811:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17865:x1875614791541248:12345-0@lo:253:mount.lustre.0 Request processed in 367us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.618818:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788726053.619010:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788726053.619020:0:17865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788726053.619023:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788726053.619024:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.619025:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.619027:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.619028:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.619029:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.619030:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.619031:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.619032:0:17865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788726053.619050:0:17865:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b139e73e000 from lustre-MDT0001 10000000:01000000:2.0:1788726053.619085:0:17865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788726053.619088:0:17865:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788726053.619094:0:17865:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b128252b370 local copy 00010000:00010000:2.0:1788726053.619103:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726053.619243:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726053.619359:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.619394:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.619444:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541376 00000100:00100000:0.0:1788726053.619449:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541376 00000100:00100000:0.0:1788726053.619486:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788726053.619494:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17865:x1875614791541376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726053.619577:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17865:x1875614791541376:12345-0@lo:501:mount.lustre.0 Request processed in 84us (218us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788726053.619583:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788726053.619686:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788726053.619769:0:17865:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788726053.619788:0:17865:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788726053.619795:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.619803:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.619827:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b139e73e000 10000000:01000000:2.0:1788726053.619831:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788726053.619835:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b128252b370 10000000:01000000:2.0:1788726053.619837:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788726053.619840:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b128252b370 from 1 10000000:01000000:2.0:1788726053.619843:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788726053.619864:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.619872:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.619882:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726053.619980:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726053.620005:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.620026:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.620072:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541504 00000100:00100000:0.0:1788726053.620076:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541504 00000100:00100000:0.0:1788726053.620107:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788726053.620113:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+12:17865:x1875614791541504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.620153:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726053.620168:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a9400/0xa13c582691d3804c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38045 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620186:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a9400/0xa13c582691d3804c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38045 expref: 13 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620196:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a9400/0xa13c582691d3804c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38045 expref: 13 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620204:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9400, rc 0) 00000100:00100000:0.0:1788726053.620233:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+13:17865:x1875614791541504:12345-0@lo:101:mount.lustre.0 Request processed in 119us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.620238:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788726053.620464:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726053.620476:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3804c expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.620484:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3804c expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.620497:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788726053.620547:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3804c expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.620554:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6000/0xa13c582691d38045 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3804c expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.620560:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b139e73e000 10000000:01000000:2.0:1788726053.620564:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788726053.620567:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9b139e73e000 from 1 10000000:01000000:2.0:1788726053.620569:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788726053.620583:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.620590:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.620598:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726053.620617:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726053.620642:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.620660:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.620847:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541632 00000100:00100000:0.0:1788726053.620851:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541632 00000100:00100000:0.0:1788726053.620893:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726053.620901:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+13:17865:x1875614791541632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.620909:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726053.620918:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a8400/0xa13c582691d3805a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38053 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620932:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a8400/0xa13c582691d3805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38053 expref: 14 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620940:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a8400/0xa13c582691d3805a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38053 expref: 14 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.620954:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8400, rc 0) 00000100:00100000:0.0:1788726053.620984:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+14:17865:x1875614791541632:12345-0@lo:101:mount.lustre.0 Request processed in 84us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.620990:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788726053.621192:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726053.621205:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3805a expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.621212:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3805a expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.621223:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788726053.621608:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3805a expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.621617:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6800/0xa13c582691d38053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3805a expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.621624:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788726053.621628:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726053.621634:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b139e73e000 10000000:01000000:2.0:1788726053.621636:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788726053.621639:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788726053.621641:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788726053.621659:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.621666:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.621681:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726053.621695:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726053.621746:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.621809:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.621956:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541760 00000100:00100000:0.0:1788726053.621961:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541760 00000100:00100000:0.0:1788726053.622025:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788726053.622033:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+14:17865:x1875614791541760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.622042:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726053.622051:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a9600/0xa13c582691d38068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38061 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.622066:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a9600/0xa13c582691d38068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38061 expref: 15 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.622087:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a9600/0xa13c582691d38068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38061 expref: 15 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.622094:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9600, rc 0) 00000100:00100000:0.0:1788726053.622151:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791541760:12345-0@lo:101:mount.lustre.0 Request processed in 119us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.622158:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788726053.622281:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726053.622294:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38068 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.622301:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38068 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726053.623872:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788726053.624597:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726053.629556:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788726053.629608:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788726053.629621:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788726053.629632:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788726053.629644:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788726053.629654:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788726053.629665:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788726053.629683:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788726053.629695:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788726053.629781:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788726053.629796:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788726053.629808:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788726053.629819:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788726053.629830:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788726053.629841:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788726053.629852:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788726053.629866:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788726053.629877:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788726053.629954:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788726053.629973:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788726053.629987:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788726053.630000:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788726053.630011:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788726053.630038:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788726053.630044:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788726053.630162:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726053.630223:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.630259:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389ebd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.630403:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791541888 00000100:00100000:2.0:1788726053.630412:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791541888 00000100:00100000:2.0:1788726053.630462:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788726053.630472:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791541888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726053.630627:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791541888:12345-0@lo:501:mount.lustre.0 Request processed in 156us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.630635:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788726053.630811:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791541888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726053.630842:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788726053.630976:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.631043:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389ebd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.631074:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542016 00000100:00100000:0.0:1788726053.631079:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542016 00000100:00100000:0.0:1788726053.631213:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788726053.631223:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726053.631980:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542016:12345-0@lo:503:mount.lustre.0 Request processed in 756us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.631995:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788726053.632225:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542016:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788726053.633009:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788726053.633084:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726053.633166:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.633193:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389ebd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.633333:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542144 00000100:00100000:2.0:1788726053.633340:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542144 00000100:00100000:2.0:1788726053.633380:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788726053.633389:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.634609:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542144:12345-0@lo:502:mount.lustre.0 Request processed in 1217us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.634619:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788726053.634870:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726053.635367:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788726053.635398:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788726053.635415:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788726053.635428:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788726053.635438:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788726053.635450:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788726053.635462:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788726053.635473:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788726053.635484:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788726053.635497:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788726053.635510:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788726053.635522:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788726053.635536:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788726053.635550:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788726053.635565:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788726053.635578:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788726053.635592:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788726053.635605:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788726053.635617:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788726053.635631:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788726053.635645:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788726053.635658:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788726053.635670:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788726053.635685:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788726053.635779:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788726053.635799:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788726053.635813:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788726053.635827:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788726053.635853:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788726053.635865:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788726053.635878:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788726053.635966:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788726053.635982:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788726053.635995:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788726053.636008:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788726053.636021:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788726053.636034:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788726053.636048:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788726053.636059:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788726053.636070:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788726053.636080:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788726053.636090:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788726053.636101:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788726053.636111:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788726053.636179:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726053.636236:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726053.636376:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542272 00000100:00100000:3.0:1788726053.636383:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542272 00000100:00100000:3.0:1788726053.636434:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788726053.636442:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726053.636534:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542272:12345-0@lo:502:mount.lustre.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.636542:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788726053.636647:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1389ebd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726053.636662:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726053.636698:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788726053.636775:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788726053.637806:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726053.637817:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.637819:0:17869:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788726053.637824:0:17869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788726053.637827:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726053.637841:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9b13bd5b8000) 00000020:00000080:1.0:1788726053.637859:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788726053.637863:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788726053.637996:0:17869:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788726053.638008:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d38076 00000020:00000080:1.0:1788726053.638558:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788726053.638565:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726053.638570:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.638571:0:17869:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788726053.638574:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726053.638578:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.638579:0:17869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788726053.638583:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726053.638591:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9b13bd5bcd28) 00000020:00000080:1.0:1788726053.638603:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788726053.638607:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788726053.638609:0:17869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788726053.638611:0:17869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788726053.638617:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788726053.638676:0:17869:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139e73e000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788726053.638689:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9b13bd5bb370) 00000020:00000080:1.0:1788726053.638697:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788726053.638825:0:17869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788726053.638831:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d3808b 00000020:00000080:1.0:1788726053.639001:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788726053.639008:0:17869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788726053.639014:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa13c582691d38092 00080000:01000000:1.0:1788726053.639019:0:17869:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788726053.639022:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d38099 00010000:00010000:2.0:1788726053.755296:0:17869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788726053.756387:0:17869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788726053.756777:0:17869:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788726053.770049:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788726053.770063:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726053.770086:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.770089:0:17869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788726053.770094:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726053.770101:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.770102:0:17869:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788726053.770105:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788726053.770111:0:17869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:00000080:2.0:1788726053.770167:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726053.770183:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9b1282528000) 00000020:00000080:2.0:1788726053.770204:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788726053.770209:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788726053.770463:0:17869:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788726053.770469:0:17869:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788726053.770476:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d380a7 00010000:00080000:2.0:1788726053.770509:0:17869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b139116e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788726053.783585:0:17869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788726053.788064:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788726053.788080:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788726053.788349:0:17869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788726053.788370:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d380ae 00000100:00080000:2.0:1788726053.788380:0:17869:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726053.788385:0:17869:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9b139116e800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726053.788416:0:17869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387637b80 x1875614791542400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788726053.788470:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542400:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788726053.788600:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.788691:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542400 00000100:00080000:2.0:1788726053.788692:0:17869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788726053.788701:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542400 00000100:00100000:1.0:1788726053.788747:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726053.788756:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791542400:12345-0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788726053.788762:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726053.788768:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788770:0:17869:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788726053.788773:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788726053.788776:0:17869:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788726053.788778:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726053.788780:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00010000:00080000:1.0:1788726053.788781:0:17138:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:01000000:2.0:1788726053.788793:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788726053.788797:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788798:0:17869:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788726053.788801:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726053.788806:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788808:0:17869:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788726053.788813:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:00000080:1.0:1788726053.788819:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d380b5 00000004:00100000:1.0:1788726053.788833:0:17138:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788726053.788845:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000004:01000000:2.0:1788726053.788847:0:17869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788726053.788859:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726053.788863:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788864:0:17869:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788726053.788866:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788726053.788868:0:17869:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788726053.788869:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726053.788871:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726053.788873:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788726053.788876:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788877:0:17869:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788726053.788879:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788726053.788882:0:17869:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788726053.788895:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.788897:0:17869:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788726053.788900:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788726053.788904:0:17869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788726053.788924:0:17869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788726053.788926:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726053.788939:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9b13a96d0000) 00000020:00000080:2.0:1788726053.788957:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788726053.788961:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788726053.789020:0:17869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788726053.789026:0:17869:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788726053.789032:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d380c3 00010000:00080000:2.0:1788726053.789056:0:17869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13842be800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.112@tcp at head 00000100:00080000:0.0:1788726053.789544:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726053.789549:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788726053.789552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726053.789554:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788726053.789674:0:17869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1788726053.790495:0:17869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788726053.790758:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788726053.795954:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788726053.797977:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9b1281a3e000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788726053.800929:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788726053.801167:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1788726053.802573:0:17874:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788726053.802579:0:17874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788726053.802847:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791542400:12345-0@lo:38:llog_process_th.0 Request processed in 14086us (14241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.802860:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:2.0:1788726053.804241:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788726053.804255:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788726053.804294:0:17869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788726053.804316:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d380ca 00000100:00080000:2.0:1788726053.804325:0:17869:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788726053.804330:0:17869:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b13842be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726053.804361:0:17869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1387637100 x1875614791542528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726053.804377:0:17869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788726053.804439:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726053.804444:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.804446:0:17869:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788726053.804449:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788726053.804451:0:17869:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788726053.804453:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726053.804455:0:17869:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788726053.804456:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788726053.804458:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.804459:0:17869:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788726053.804461:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788726053.804465:0:17869:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788726053.804469:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726053.804470:0:17869:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788726053.804473:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788726053.804477:0:17869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:2.0:1788726053.804499:0:17869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788726053.804508:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726053.804519:0:17869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9b13a96d19b8) 00000020:00000080:2.0:1788726053.804664:0:17869:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788726053.804670:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788726053.804744:0:17869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788726053.804751:0:17869:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788726053.804757:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa13c582691d380d8 00010000:00080000:2.0:1788726053.804784:0:17869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b139116b000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:2.0:1788726053.804971:0:17869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788726053.805035:0:17869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788726053.805049:0:17869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788726053.805812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726053.805819:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788726053.805822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726053.805825:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788726053.808403:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726053.808417:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788726053.808425:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788726053.808431:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788726053.808435:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788726053.808450:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788726053.808783:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542528:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788726053.808832:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791542528 offset 0 length 520: 4 00000100:00100000:1.0:1788726053.808907:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726053.808918:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791542656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788726053.808959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.809162:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542656 00000100:00100000:2.0:1788726053.809169:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542656 00000100:00100000:2.0:1788726053.809211:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726053.809221:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875614791542656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788726053.809252:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726053.809818:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875614791542656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 596us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.809825:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726053.809898:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791542656:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788726053.810337:0:17869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726053.810647:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788726053.810809:0:17869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788726053.813785:0:17876:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788726053.813793:0:17876:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788726053.814599:0:17869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788726053.814611:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788726053.814651:0:17869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788726053.814673:0:17869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d380df 00000100:00080000:1.0:1788726053.814684:0:17869:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726053.814689:0:17869:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b139116b000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726053.814725:0:17869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283758000 x1875614791542784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726053.814758:0:17869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788726053.814841:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542784:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788726053.814892:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791542784 offset 0 length 520: 4 00000100:00080000:1.0:1788726053.815044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.815048:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726053.815051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.815053:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788726053.815096:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726053.815100:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.815102:0:17869:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788726053.815104:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726053.815144:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.815146:0:17869:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788726053.815151:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788726053.815153:0:17869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788726053.815155:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726053.815157:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.815158:0:17869:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788726053.815161:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726053.815163:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.815164:0:17869:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788726053.815167:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788726053.815192:0:17869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726053.815195:0:17869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726053.815196:0:17869:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788726053.815199:0:17869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788726053.815425:0:17865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788726053.815452:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788726053.815475:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38068 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815497:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7c00/0xa13c582691d38061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38068 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726053.815505:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139e73e000 from 1 10000000:01000000:0.0:1788726053.815508:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788726053.815543:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815551:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815562:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726053.815579:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726053.815616:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.815640:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.815659:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791542912 00000100:00100000:0.0:1788726053.815665:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791542912 00000100:00100000:0.0:1788726053.815707:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788726053.815716:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+15:17865:x1875614791542912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.815727:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726053.815750:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d380e6 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815773:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d380e6 expref: 16 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815794:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d380e6 expref: 16 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815804:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a9000, rc 0) 00000100:00100000:0.0:1788726053.815840:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17865:x1875614791542912:12345-0@lo:101:mount.lustre.0 Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.815847:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788726053.815893:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791542912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.815911:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.815920:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726053.816501:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543040:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788726053.816537:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.816554:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.816573:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543040 00000100:00100000:0.0:1788726053.816577:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543040 00000100:00100000:0.0:1788726053.816603:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788726053.816610:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17865:x1875614791543040:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788726053.816625:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788726053.816640:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788726053.816643:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788726053.816718:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17865:x1875614791543040:12345-0@lo:256:mount.lustre.0 Request processed in 107us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.816743:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788726053.816781:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543040:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788726053.817350:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788726053.817359:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817368:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726053.817375:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e73e000 from 1 10000000:01000000:0.0:1788726053.817377:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726053.817397:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817405:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817413:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726053.817427:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726053.817455:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.817470:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.817488:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543168 00000100:00100000:0.0:1788726053.817492:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543168 00000100:00100000:0.0:1788726053.817515:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788726053.817522:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17865:x1875614791543168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.817530:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726053.817546:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d380f4 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817561:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d380f4 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817571:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d380f4 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817578:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13af8a8800, rc 0) 00000100:00100000:0.0:1788726053.817605:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543168:12345-0@lo:101:mount.lustre.0 Request processed in 84us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.817611:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788726053.817643:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726053.817654:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.817661:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726053.817782:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726053.817809:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726053.817846:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.817860:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.817873:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543296 00000100:00100000:0.0:1788726053.817876:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543296 00000100:00100000:0.0:1788726053.817896:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726053.817902:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726053.817970:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543296:12345-0@lo:501:mount.lustre.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.817981:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726053.818014:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726053.818037:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726053.818070:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.818082:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.818093:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543424 00000100:00100000:0.0:1788726053.818097:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543424 00000100:00100000:0.0:1788726053.818140:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726053.818146:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726053.818225:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543424:12345-0@lo:503:mount.lustre.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.818232:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726053.818269:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543424:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726053.818568:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726053.818632:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726053.818664:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.818678:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.818692:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543552 00000100:00100000:0.0:1788726053.818696:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543552 00000100:00100000:0.0:1788726053.818716:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788726053.818723:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543552:12345-0@lo:502:mount.lustre.0 00010000:00010000:1.0:1788726053.819447:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726053.819901:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543552:12345-0@lo:502:mount.lustre.0 Request processed in 1174us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.819910:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788726053.820045:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726053.820304:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788726053.820332:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788726053.820345:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788726053.820357:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788726053.820368:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788726053.820381:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788726053.820395:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788726053.820407:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788726053.820418:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788726053.820430:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788726053.820442:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788726053.820471:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726053.820511:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.820553:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726053.820713:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543680 00000100:00100000:0.0:1788726053.820719:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543680 00000100:00100000:0.0:1788726053.820770:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788726053.820779:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726053.821058:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543680:12345-0@lo:502:mount.lustre.0 Request processed in 279us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.821065:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788726053.821161:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788726053.821208:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788726053.821215:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788726053.821999:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726053.822008:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.822010:0:17878:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788726053.822017:0:17878:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139e73e000 00000020:00000080:0.0:1788726053.822019:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726053.822027:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726053.822030:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.822031:0:17878:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788726053.822033:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726053.822036:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.822037:0:17878:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788726053.822040:0:17878:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139e73e000 00000020:00000080:0.0:1788726053.822042:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726053.822144:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726053.822149:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.822150:0:17878:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788726053.822152:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726053.822154:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.822155:0:17878:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788726053.822158:0:17878:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139e73e000 00000020:00000080:0.0:1788726053.822160:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726053.823221:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726053.823229:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.823231:0:17878:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788726053.823234:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726053.823243:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.823245:0:17878:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788726053.823250:0:17878:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139e73e000 00000020:00000080:0.0:1788726053.823252:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788726053.823356:0:17878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726053.823360:0:17878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726053.823361:0:17878:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788726053.823365:0:17878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788726053.834438:0:17865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788726053.834478:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726053.834492:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.834505:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726053.834588:0:17865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788726053.834592:0:17865:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b139e73e000 10000000:01000000:2.0:1788726053.834595:0:17865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b139e73e000 10000000:01000000:2.0:1788726053.834603:0:17865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726053.834609:0:17865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139e73e000 from 1 10000000:01000000:2.0:1788726053.834612:0:17865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788726053.834644:0:17865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.834652:0:17865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.834663:0:17865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726053.834684:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726053.834769:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.834805:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726053.835675:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543808 00000100:00100000:1.0:1788726053.835683:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543808 00000100:00100000:1.0:1788726053.835816:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788726053.835829:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17865:x1875614791543808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726053.835844:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726053.835858:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e600/0xa13c582691d38109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38102 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.835880:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e600/0xa13c582691d38109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38102 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.835890:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e600/0xa13c582691d38109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38102 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.835899:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e600, rc 0) 00000100:00100000:1.0:1788726053.835943:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791543808:12345-0@lo:101:mount.lustre.0 Request processed in 119us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.835950:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788726053.836365:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726053.836379:0:17865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38109 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.836389:0:17865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38109 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726053.839836:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788726053.842214:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788726053.844042:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788726053.845513:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788726053.845896:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788726053.845913:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788726053.845927:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788726053.845942:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788726053.845982:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788726053.845998:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788726053.846010:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788726053.846022:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788726053.846036:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788726053.846049:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788726053.846059:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788726053.846579:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788726053.846607:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788726053.846621:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788726053.846635:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788726053.846649:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788726053.846661:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788726053.846673:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788726053.846684:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788726053.846697:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788726053.846726:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788726053.846754:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788726053.846767:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788726053.846780:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788726053.846793:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788726053.846806:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788726053.846831:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788726053.846837:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788726053.846942:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726053.847006:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.847058:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791543936 00000100:00100000:2.0:1788726053.847065:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791543936 00000100:00100000:2.0:1788726053.847137:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788726053.847147:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791543936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726053.847257:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791543936:12345-0@lo:501:mount.lustre.0 Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.847283:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788726053.847329:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.847349:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791543936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726053.847379:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726053.847415:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.847437:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544064 00000100:00100000:2.0:1788726053.847440:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544064 00000100:00100000:2.0:1788726053.847462:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788726053.847468:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726053.847537:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544064:12345-0@lo:503:mount.lustre.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.847544:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788726053.847575:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.847588:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788726053.851047:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788726053.851157:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.851231:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.851269:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726053.851356:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544192 00000100:00100000:3.0:1788726053.851363:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544192 00000100:00100000:3.0:1788726053.851397:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788726053.851404:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726053.851494:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544192:12345-0@lo:502:mount.lustre.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.851502:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788726053.852673:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726053.852891:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788726053.852920:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788726053.852933:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788726053.852945:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788726053.852957:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788726053.852970:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788726053.852994:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788726053.853022:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788726053.853038:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788726053.853051:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788726053.853065:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788726053.854381:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788726053.854402:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788726053.854416:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788726053.854430:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788726053.854444:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788726053.854457:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788726053.854470:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788726053.854483:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788726053.854496:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788726053.854508:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788726053.858740:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788726053.858822:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788726053.858863:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788726053.858883:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788726053.858899:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788726053.858915:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788726053.858930:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788726053.858948:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788726053.858962:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788726053.858976:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788726053.858991:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788726053.859004:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788726053.859021:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788726053.859038:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788726053.859053:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788726053.859067:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788726053.859083:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788726053.859098:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788726053.859156:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788726053.859176:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788726053.859191:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788726053.859205:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788726053.859217:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788726053.859231:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788726053.859247:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788726053.859282:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788726053.859299:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788726053.859363:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.859442:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.859495:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544320 00000100:00100000:2.0:1788726053.859503:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544320 00000100:00100000:2.0:1788726053.860428:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788726053.860441:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.860834:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544320:12345-0@lo:502:mount.lustre.0 Request processed in 396us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.860843:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788726053.860920:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.861013:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726053.861465:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788726053.861494:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788726053.861602:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.861648:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.861682:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544448 00000100:00100000:2.0:1788726053.861687:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544448 00000100:00100000:2.0:1788726053.861714:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788726053.861723:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726053.861818:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791544448:12345-0@lo:502:mount.lustre.0 Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.861826:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788726053.861866:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.861880:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791544448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726053.861917:0:17865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788726053.861925:0:17865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788726053.866058:0:17883:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788726053.866354:0:17883:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9b13be5d99b8) 00000020:00000080:3.0:1788726053.866379:0:17883:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788726053.866479:0:17883:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139e73e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788726053.866489:0:17883:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139e73e000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788726053.866492:0:17883:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139e73e000 3 00010000:00080000:3.0:1788726053.866593:0:17883:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13abd3a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788726053.874899:0:17883:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788726053.876243:0:17883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788726053.876292:0:17883:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726053.876305:0:17883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa13c582691d38117 00000100:00080000:1.0:1788726053.876315:0:17883:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726053.876320:0:17883:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9b13abd3a000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726053.876352:0:17883:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283758700 x1875614791544576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726053.876386:0:17883:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788726053.876419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788726053.876423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788726053.876425:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788726053.876430:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1788726053.876433:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788726053.876436:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726053.876462:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b128375a680 x1875614791544704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726053.876472:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.876475:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726053.876478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.876481:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726053.876518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.876521:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788726053.876524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788726053.876527:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788726053.876550:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791544832:0@lo:400:kworker.0 00000100:00100000:2.0:1788726053.877275:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791544576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726053.877356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.877399:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791544704:0@lo:38:kworker.0 00000100:00100000:2.0:1788726053.877423:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.877458:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544576 00000100:00100000:2.0:1788726053.877465:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544576 00000100:00100000:2.0:1788726053.877496:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726053.877503:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791544576:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788726053.877540:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1788726053.877571:0:17135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa13c582691d3811e 00000004:00100000:2.0:1788726053.877584:0:17135:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788726053.877613:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b13ac713000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726053.877662:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875614791544576:12345-0@lo:38:llog_process_th.0 Request processed in 158us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.877669:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726053.877689:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544704 00000100:00100000:2.0:1788726053.877693:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544704 00000100:00100000:1.0:1788726053.877698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.877709:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726053.877714:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791544704:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788726053.877743:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791544960:0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.877764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.877768:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1875614791544704:12345-0@lo:38:kworker.0 Request processed in 52us (344us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788726053.877774:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726053.877783:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544960 00000100:00100000:2.0:1788726053.877786:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544960 00000100:00100000:1.0:1788726053.877797:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791544832 00000100:00100000:1.0:1788726053.877800:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791544832 00000100:00100000:2.0:1788726053.877803:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726053.877808:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875614791544960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.877822:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726053.877828:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791544832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726053.877841:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875614791544960:12345-0@lo:400:kworker.0 Request processed in 33us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.877848:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788726053.877857:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791544832:12345-0@lo:400:kworker.0 Request processed in 29us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.877863:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788726053.877883:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1283758e00 x1875614791544832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726053.877884:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791544960:0@lo:400:kworker.0 00000100:00100000:1.0:1788726053.877892:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791544832:0@lo:400:kworker.0 00010000:00080000:2.0:1788726053.877910:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1283758700 x1875614791544576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726053.877918:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788726053.877923:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788726053.877930:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788726053.877934:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788726053.877936:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13abd3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788726053.877941:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875614791544576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788726053.877950:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788726053.877953:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726053.877957:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788726053.877959:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791544704:0@lo:38:kworker.0 00000040:00080000:1.0:1788726053.880298:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788726053.881396:0:17865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788726053.881433:0:17865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788726053.881463:0:17865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38109 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726053.881476:0:17865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6a00/0xa13c582691d38102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38109 expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788726053.881549:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788726053.881551:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.881553:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.881554:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.881555:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.881556:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.881558:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.881559:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.881561:0:17865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726053.881564:0:17865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788726053.881567:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788726053.881568:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.881569:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.881570:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.881571:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.881572:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.881573:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.881574:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.881575:0:17865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788726053.881599:0:17865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788726053.881618:0:17865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791545088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788726053.881687:0:17865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.881724:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545088 00000100:00100000:2.0:1788726053.881741:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545088 00000100:00100000:2.0:1788726053.881782:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788726053.881791:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1391fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791545088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788726053.881818:0:17128:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788726053.881832:0:17128:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788726053.881947:0:17865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12823d2780 going to sleep for 11 seconds 00000001:00100000:0.0:1788726053.888177:0:17113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788726053.888636:0:17128:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788726053.888651:0:17128:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788726053.888937:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1391fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17865:x1875614791545088:12345-0@lo:253:mount.lustre.0 Request processed in 7139us (7241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.888951:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788726053.888955:0:17865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:17865:1875614791545088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788726053.888974:0:17865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788726053.888979:0:17865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788726053.888981:0:17865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788726053.888982:0:17865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726053.888984:0:17865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726053.888985:0:17865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726053.888987:0:17865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726053.888989:0:17865:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788726053.888991:0:17865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726053.888992:0:17865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788726053.889008:0:17865:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788726053.890078:0:17149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788726053.890085:0:17149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788726053.890108:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890140:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890147:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d380e6 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890154:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890191:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890206:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726053.890229:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791545216:0@lo:104: 00000100:00100000:1.0:1788726053.890278:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726053.890325:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.890332:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726053.890340:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791545344:0@lo:104: 00000100:00100000:1.0:1788726053.890360:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.890377:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13891233c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726053.890499:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545216 00000100:00100000:3.0:1788726053.890507:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545216 00000100:00100000:3.0:1788726053.890546:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545344 00000100:00100000:3.0:1788726053.890549:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545344 00000100:00100000:3.0:1788726053.890563:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726053.890571:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:17149:x1875614791545216:12345-0@lo:104: 00010000:00010000:3.0:1788726053.890583:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726053.890638:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726053.890643:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:17149:x1875614791545216:12345-0@lo:104: Request processed in 73us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.890649:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726053.890665:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788726053.890671:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791545344:12345-0@lo:104: 00010000:00010000:3.0:1788726053.890678:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726053.890709:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788726053.890714:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791545344:12345-0@lo:104: Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.890727:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788726053.893970:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726053.893983:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.893994:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788726053.893999:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894009:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726053.894016:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726053.894023:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788726053.894068:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894074:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726053.894104:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894110:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9a00/0xa13c582691d380e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380ed expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894152:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726053.894155:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894161:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:0.0:1788726053.894163:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894171:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788726053.894188:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726053.894193:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788726053.894208:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894213:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788726053.894228:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894234:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9200/0xa13c582691d38022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38029 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.894246:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726053.894248:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726053.894250:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726053.894949:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726053.894997:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791545216:0@lo:104: 00000100:00100000:1.0:1788726053.895010:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791545344:0@lo:104: 00010000:00010000:1.0:1788726053.895036:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726053.895210:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791545472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726053.895269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726053.895334:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545472 00000100:00100000:1.0:1788726053.895340:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545472 00010000:00010000:1.0:1788726053.895368:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 18 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726053.895398:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726053.895407:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:3641:x1875614791545472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726053.895431:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726053.895437:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 18 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.895447:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 18 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.895462:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13af8a9000/0xa13c582691d380ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d380e6 expref: 18 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726053.895476:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726053.895520:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:3641:x1875614791545472:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726053.895527:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788726053.895570:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791545472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726053.896796:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791545600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726053.896848:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726053.896897:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545600 00000100:00100000:0.0:1788726053.896902:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545600 00010000:00010000:0.0:1788726053.896926:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726053.896951:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726053.896959:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:3638:x1875614791545600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726053.896969:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726053.896974:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.896984:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.896998:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1384c8f400/0xa13c582691d38029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d38022 expref: 17 pid: 17126 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897010:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897018:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788726053.897033:0:17120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006948171s 00010000:00010000:0.0:1788726053.897037:0:17120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897044:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897060:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897066:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897071:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ec00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726053.897076:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897082:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897097:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897106:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726053.897152:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:3638:x1875614791545600:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726053.897159:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788726053.897189:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791545600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726053.897289:0:17149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897298:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726053.897304:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38125 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788726053.899602:0:17865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788726053.899736:0:17889:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788726053.899741:0:17889:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788726053.901784:0:17890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788726053.902916:0:17865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1788726053.903651:0:17865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788726053.903693:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788726053.904084:0:17865:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788726053.904091:0:17865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788726053.904146:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726053.905726:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788726053.905856:0:17891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791545728:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788726053.905931:0:17891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726053.905961:0:17891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874c6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726053.908075:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545728 00000100:00100000:3.0:1788726053.908088:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545728 00000100:00100000:3.0:1788726053.908164:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788726053.908175:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791545728:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788726053.908292:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791545728:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726053.908299:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788726053.908352:0:17891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791545728:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788726053.908397:0:17891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788726053.908435:0:17891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791545856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788726053.908468:0:17891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788726053.908703:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788726053.908773:0:17890:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788726053.909350:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788726053.909402:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545856 00000100:00100000:2.0:1788726053.909408:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545856 00000100:00100000:2.0:1788726053.909444:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788726053.909452:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791545856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788726053.910004:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788726053.910013:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788726053.910037:0:17891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.910813:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791545856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1358us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.910823:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788726053.910876:0:17891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791545856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.910950:0:17891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17891:1875614791545984:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.910981:0:17891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.911024:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791545984 00000100:00100000:2.0:1788726053.911029:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791545984 00000100:00100000:2.0:1788726053.911058:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726053.911066:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17891:x1875614791545984:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.911103:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17891:x1875614791545984:12345-0@lo:900:lod0001_rec0000.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.911109:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788726053.911791:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788726053.911850:0:17865:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788726053.914084:0:17865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788726053.914672:0:17891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649a6c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788726053.914712:0:17891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1387634a80 x1875614791545984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788726069 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726053.914727:0:17891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17891:1875614791545984:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.914806:0:17891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791546112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.914868:0:17891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726053.914902:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546112 00000100:00100000:2.0:1788726053.914908:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546112 00000100:00100000:2.0:1788726053.914944:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726053.914952:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791546112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788726053.915013:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17891:x1875614791546112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726053.915019:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726053.915036:0:17891:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726053.915048:0:17891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17891:1875614791546112:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788726053.915087:0:17891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788726053.916392:0:17865:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1788726053.922767:0:17865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1788726053.923417:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788726053.923482:0:17891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788726053.923487:0:17891:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1788726053.938634:0:17865:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788726053.938671:0:17865:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaf82453d7988 00100000:10000000:3.0:1788726053.938689:0:17865:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788726053.939466:0:17865:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788726053.939499:0:17865:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788726053.939516:0:17865:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788726053.939540:0:17865:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788726053.946804:0:17865:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788726053.947072:0:17865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788726054.395183:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726054.844583:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726054.908586:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788726055.419744:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 10000000:01000000:2.0:1788726055.485873:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788726055.485881:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139e73e000 from 8 10000000:01000000:2.0:1788726055.485886:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788726055.485970:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726055.485981:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726055.485993:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726055.486018:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788726055.486082:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726055.487590:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726055.489896:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546240 00000100:00100000:3.0:1788726055.489910:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546240 00000100:00100000:3.0:1788726055.490235:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788726055.490245:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1391fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17131:x1875614791546240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726055.490261:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726055.490281:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3812c expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.490308:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3812c expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.490319:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3812c expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.490328:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ee00, rc 0) 00000100:00100000:3.0:1788726055.490399:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1391fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791546240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (4317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726055.490406:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788726055.491018:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726055.491037:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726055.491047:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726055.491113:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788726055.491186:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726055.491217:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788726055.491358:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546368 00000100:00100000:3.0:1788726055.491364:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546368 00000100:00100000:3.0:1788726055.491409:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788726055.491417:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791546368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788726055.491434:0:17128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788726055.491455:0:17128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788726055.491458:0:17128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788726055.491546:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791546368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726055.491553:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788726055.491740:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788726055.491787:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788726055.491795:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726055.491804:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726055.491814:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788726055.491816:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b1283ea8000 from 8 10000000:01000000:1.0:1788726055.491819:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788726055.491839:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726055.491853:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726055.491862:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726055.491877:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788726055.491906:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726055.491942:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13958d7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788726055.492259:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546496 00000100:00100000:3.0:1788726055.492265:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546496 00000100:00100000:3.0:1788726055.492297:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788726055.492306:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791546496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726055.492316:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726055.492326:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3813a expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.492343:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3813a expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.492351:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3813a expref: 18 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.492359:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f800, rc 0) 00000100:00100000:3.0:1788726055.492394:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791546496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726055.492400:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788726055.492432:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726055.492443:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.492451:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726055.492507:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788726055.492535:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726055.492555:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726055.492567:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546624 00000100:00100000:3.0:1788726055.492570:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546624 00000100:00100000:3.0:1788726055.492587:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788726055.492593:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791546624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788726055.492605:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788726055.492618:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788726055.492622:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788726055.492688:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791546624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726055.492694:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788726055.493168:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791546624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788726055.493207:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788726055.493213:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726055.493221:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726055.871335:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726055.931996:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788726056.443226:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726056.891361:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726057.467217:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:1.0:1788726057.915302:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788726057.960003:0:18134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788726058.494379:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 0 seconds 00010000:00010000:0.0:1788726058.961463:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788726059.052656:0:18187:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788726059.053914:0:18187:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1788726059.133202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:3.0:1788726059.133211:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788726059.133212:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788726059.133218:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788726059.133236:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9b13af851800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726059.133239:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791546752:0@lo:400:kworker.0 00000100:00100000:0.0:1788726059.133266:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282599500 x1875614791546880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726059.133289:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726059.133293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788726059.133297:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726059.133300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788726059.133338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788726059.133358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726059.133362:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788726059.133366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788726059.133369:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788726059.133428:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791547264:0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.133468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726059.133497:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726059.133503:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791547392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788726059.133534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726059.133541:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547264 00000100:00100000:0.0:1788726059.133551:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547264 00000100:00100000:3.0:1788726059.133569:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791546880:0@lo:38:kworker.0 00000100:00100000:0.0:1788726059.133608:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726059.133610:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726059.133623:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791547264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.133648:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791547008:0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.133689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726059.133712:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791547264:12345-0@lo:400:kworker.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.133721:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726059.133725:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726059.133733:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791547136:0@lo:400:kworker.0 00000100:00100000:0.0:1788726059.133741:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547008 00000100:00100000:0.0:1788726059.133746:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547008 00000100:00100000:3.0:1788726059.133759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726059.133767:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726059.133775:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791547008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.133797:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546752 00000100:00100000:3.0:1788726059.133802:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546752 00000100:00100000:0.0:1788726059.133817:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791547008:12345-0@lo:400:kworker.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.133826:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726059.133842:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788726059.133850:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547392 00000100:00100000:3.0:1788726059.133853:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:3638:x1875614791546752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.133888:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:3638:x1875614791546752:12345-0@lo:400:kworker.0 Request processed in 38us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726059.133895:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788726059.133931:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791546880 00000100:00100000:3.0:1788726059.133935:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791546880 00000100:00100000:3.0:1788726059.133962:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547136 00000100:00100000:3.0:1788726059.133965:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547136 00000100:00100000:3.0:1788726059.133983:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788726059.133988:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1875614791546880:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788726059.134019:0:17139:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1788726059.134064:0:17139:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d38148 00000004:00100000:3.0:1788726059.134096:0:17139:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788726059.134104:0:17139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788726059.134227:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726059.134237:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791547136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.134281:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791547136:12345-0@lo:400:kworker.0 Request processed in 45us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726059.134288:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726059.134339:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791547136:0@lo:400:kworker.0 00010000:00080000:3.0:1788726059.134354:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1282598000 x1875614791547008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726059.134364:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791547008:0@lo:400:kworker.0 00010000:00080000:3.0:1788726059.134396:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b128259b480 x1875614791547264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726059.134405:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791547264:0@lo:400:kworker.0 00000100:00100000:3.0:1788726059.134414:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791546752:0@lo:400:kworker.0 00000100:00100000:0.0:1788726059.135427:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547392 00000100:00100000:0.0:1788726059.135486:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726059.135496:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791547392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788726059.135532:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726059.135608:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791547392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.135627:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726059.135687:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791547392:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788726059.148716:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9b139d94e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726059.148979:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791546880:12345-0@lo:38:kworker.0 Request processed in 14986us (15367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726059.148992:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788726059.159406:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788726059.159428:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788726059.159438:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788726059.159443:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13af851800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788726059.159481:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008ae5aac3): req@ffff9b128259b800 x1875614791539456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726059.159517:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791546880:0@lo:38:kworker.0 00000100:00100000:2.0:1788726059.159689:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788726059.159721:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791547520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788726059.159770:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726059.159834:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384854240 going to sleep for 11 seconds 00000100:00100000:2.0:1788726059.159864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726059.159914:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791539456 00000100:00100000:2.0:1788726059.159922:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791539456 00000100:00100000:2.0:1788726059.159986:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547520 00000100:00100000:2.0:1788726059.159990:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547520 00000100:00100000:2.0:1788726059.160009:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788726059.160019:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17175:x1875614791539456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160149:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17175:x1875614791539456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.160151:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788726059.160165:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788726059.160167:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791547520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788726059.160199:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788726059.160205:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259b800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17175:1875614791539456:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788726059.160256:0:17175:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788726059.160266:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791547520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726059.160274:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788726059.160297:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17175:1875614791547648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160333:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726059.160355:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726059.160379:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791547520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788726059.160411:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547648 00000100:00100000:2.0:1788726059.160415:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547648 00000100:00100000:2.0:1788726059.160438:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788726059.160445:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17175:x1875614791547648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160574:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17175:x1875614791547648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726059.160581:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788726059.160610:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17175:1875614791547648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160716:0:17175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17175:1875614791547776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160746:0:17175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726059.160773:0:17175:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788726059.160787:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547776 00000100:00100000:2.0:1788726059.160791:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547776 00000100:00100000:2.0:1788726059.160811:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788726059.160824:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17175:x1875614791547776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788726059.160885:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17175:x1875614791547776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726059.160891:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788726059.160944:0:17175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17175:1875614791547776:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788726059.160998:0:17175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726059.169648:0:17175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788726059.169772:0:17175:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:0.0:1788726059.169778:0:17175:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788726059.970151:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788726060.165923:0:18237:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788726060.166277:0:18237:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788726060.987486:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788726061.215756:0:18287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc67411130 20000000:00000080:2.0:1788726061.215781:0:18287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b13ac74f800 uarg=0000000000000000 20000000:01000000:2.0:1788726061.215840:0:18287:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788726061.215849:0:18287:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788726061.215855:0:18287:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788726061.216673:0:18288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788726061.216895:0:18287:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788726061.222799:0:18287:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788726061.222844:0:18287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.222868:0:18287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.222877:0:18287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d380f4 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.222886:0:18287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.222968:0:18287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 17 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.222986:0:18287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 17 pid: 17128 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726061.223005:0:18287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1875614791547904:0@lo:104: 00000100:00100000:2.0:1788726061.223097:0:18287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788726061.223220:0:18287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.223230:0:18287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726061.223239:0:18287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1875614791548032:0@lo:104: 00000100:00100000:2.0:1788726061.223266:0:18287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726061.223284:0:18287:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13bd6b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726061.223645:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791547904 00000100:00100000:3.0:1788726061.223657:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791547904 00000100:00100000:3.0:1788726061.223726:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548032 00000100:00100000:3.0:1788726061.223730:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548032 00000100:00100000:3.0:1788726061.223749:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726061.223760:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:18287:x1875614791547904:12345-0@lo:104: 00010000:00010000:3.0:1788726061.223778:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726061.223877:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726061.223884:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:18287:x1875614791547904:12345-0@lo:104: Request processed in 126us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726061.223893:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726061.223916:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726061.223923:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:18287:x1875614791548032:12345-0@lo:104: 00010000:00010000:3.0:1788726061.223931:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726061.223966:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788726061.223971:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:18287:x1875614791548032:12345-0@lo:104: Request processed in 50us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726061.223976:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788726061.224078:0:18287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1875614791547904:0@lo:104: 00000100:00100000:2.0:1788726061.224088:0:18287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18287:1875614791548032:0@lo:104: 00010000:00010000:2.0:1788726061.224141:0:18287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224416:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788726061.224426:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224435:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788726061.224439:0:17121:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224450:0:17121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726061.224458:0:17121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726061.224465:0:17121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788726061.224484:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726061.224570:0:17121:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224588:0:17121:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726061.224619:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224626:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d380f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d380fb expref: -99 pid: 17865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224642:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726061.224644:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726061.224646:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726061.224822:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791548160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726061.224878:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726061.224881:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726061.224883:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726061.224905:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224913:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7800 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788726061.224916:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224923:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726061.224930:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726061.224936:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788726061.224992:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.224999:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726061.225032:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.225040:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7800/0xa13c582691d37ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d37ff8 expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726061.225054:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726061.225056:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726061.225058:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726061.225066:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726061.225077:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791548288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726061.225145:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726061.225293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726061.225436:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548160 00000100:00100000:1.0:1788726061.225442:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548160 00000100:00100000:0.0:1788726061.225452:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548288 00000100:00100000:0.0:1788726061.225456:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548288 00010000:00010000:1.0:1788726061.225472:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 19 pid: 17128 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225472:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 19 pid: 17126 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726061.225512:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788726061.225522:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:3641:x1875614791548160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788726061.225528:0:17119:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788726061.225536:0:17119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788726061.225539:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726061.225545:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 19 pid: 17128 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225558:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 19 pid: 17128 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225575:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13af8a8800/0xa13c582691d380fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d380f4 expref: 19 pid: 17128 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225595:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726061.225630:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:3641:x1875614791548160:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726061.225637:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788726061.225654:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726061.225661:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:3639:x1875614791548288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726061.225669:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726061.225673:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225704:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726061.225709:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791548160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726061.225714:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13af8a8e00/0xa13c582691d37ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d37ff1 expref: 17 pid: 17126 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225725:0:17118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225735:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225828:0:17118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.225836:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.226051:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.226059:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.226065:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726061.226069:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.226078:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.226379:0:18287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726061.226389:0:18287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.227303:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.227322:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d3814f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726061.227342:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726061.227428:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:3639:x1875614791548288:12345-0@lo:103:ldlm_bl.0 Request processed in 1763us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726061.227437:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726061.227567:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791548288:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1788726061.499749:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788726062.011334:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726063.035391:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788726063.170387:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788726063.170398:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e73e000 from 13 10000000:01000000:1.0:1788726063.170405:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788726063.170465:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.170478:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.170492:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726063.170554:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.170642:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726063.170707:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726063.173355:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548416 00000100:00100000:3.0:1788726063.173490:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548416 00000100:00100000:3.0:1788726063.173595:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788726063.173608:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+16:17131:x1875614791548416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726063.173630:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726063.173659:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38156 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.173701:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38156 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.173731:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38156 expref: 17 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.173742:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8e400, rc 0) 00000100:00100000:3.0:1788726063.173862:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726063.173869:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788726063.173947:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128375b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726063.173968:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.173978:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726063.174094:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.174189:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726063.174227:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128238f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788726063.174244:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548544 00000100:00100000:3.0:1788726063.174247:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548544 00000100:00100000:3.0:1788726063.174276:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788726063.174285:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.174430:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726063.174437:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788726063.174470:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.174513:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.174553:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726063.174567:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788726063.174577:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548672 00000100:00100000:3.0:1788726063.174580:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548672 00000100:00100000:3.0:1788726063.174599:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788726063.174604:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.174698:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726063.174706:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788726063.174745:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788726063.181906:0:18376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788726063.182031:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788726063.182067:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726063.182083:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.182097:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726063.182107:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788726063.182111:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1283ea8000 from 13 10000000:01000000:3.0:1788726063.182145:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726063.182198:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.182206:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726063.182236:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726063.182267:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726063.183316:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726063.183381:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788726063.183488:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548800 00000100:00100000:1.0:1788726063.183508:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548800 00000100:00100000:1.0:1788726063.183577:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788726063.183588:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+17:17131:x1875614791548800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726063.183612:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726063.183630:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38164 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.183659:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38164 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.183684:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38164 expref: 18 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.183694:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788726063.183748:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791548800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726063.183755:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788726063.183807:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726063.183824:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.183834:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726063.183930:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.183960:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726063.183976:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138649acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726063.183990:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791548928 00000100:00100000:1.0:1788726063.183993:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791548928 00000100:00100000:1.0:1788726063.184017:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788726063.184023:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791548928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.184196:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791548928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726063.184203:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788726063.184235:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791548928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.184266:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791549056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.184309:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726063.184331:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726063.184342:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791549056 00000100:00100000:1.0:1788726063.184345:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791549056 00000100:00100000:1.0:1788726063.184366:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788726063.184372:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791549056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726063.184465:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:17131:x1875614791549056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726063.184472:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788726063.184508:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791549056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788726063.190358:0:18377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788726063.190786:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788726063.190834:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788726063.190849:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726063.190864:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726063.229262:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726053/real 1788726053] req@ffff9b1283758000 x1875614791542784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229305:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b1283758000 x1875614791542784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229318:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726053/real 1788726053] req@ffff9b1387637100 x1875614791542528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229330:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b1387637100 x1875614791542528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229341:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726048/real 1788726048] req@ffff9b128346ce00 x1875614791540480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229355:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b128346ce00 x1875614791540480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229364:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726048/real 1788726048] req@ffff9b128346ed80 x1875614791540608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726063.229373:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b128346ed80 x1875614791540608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788726063.229409:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726063.229432:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726063.229437:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542784:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788726063.229452:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726063.229458:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726063.229461:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791542528:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788726063.229466:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726063.229470:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726063.229473:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540480:0@lo:8:kworker.0 00000100:00080000:3.0:1788726063.229478:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726063.229482:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788726063.229485:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791540608:0@lo:8:kworker.0 00000100:00080000:2.0:1788726063.229739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726063.229744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788726063.229747:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726063.229754:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1788726063.229759:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788726063.229767:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b13968fc800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726063.229791:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b12833bd880 x1875614791549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726063.229804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726063.229807:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788726063.229809:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726063.229811:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1788726063.229814:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788726063.229817:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b1390daa000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726063.229829:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b12833bfb80 x1875614791549440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726063.229864:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726063.229867:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788726063.229869:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13842be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726063.229872:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1788726063.229875:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788726063.229878:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b13842be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726063.229904:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b12833bd500 x1875614791549824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788726063.229913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726063.229915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788726063.229917:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788726063.229920:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:2.0:1788726063.229923:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788726063.229927:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b139116b000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788726063.229936:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b12833bea00 x1875614791549952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788726063.229975:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791550080:0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726063.230103:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726063.230109:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791549184:0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726063.230186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791549568:0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230210:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726063.230227:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726063.230232:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791549696:0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726063.230302:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550080 00000100:00100000:2.0:1788726063.230311:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550080 00000100:00100000:2.0:1788726063.230364:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791549568 00000100:00100000:2.0:1788726063.230367:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791549568 00000100:00100000:2.0:1788726063.230387:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726063.230398:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791550080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230577:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791550080:12345-0@lo:400:kworker.0 Request processed in 178us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726063.230586:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726063.230606:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726063.230614:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791549568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230648:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791549568:12345-0@lo:400:kworker.0 Request processed in 36us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726063.230654:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726063.230686:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791549184 00000100:00100000:2.0:1788726063.230691:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791549184 00000100:00100000:2.0:1788726063.230718:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791549696 00000100:00100000:2.0:1788726063.230720:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791549696 00000100:00100000:2.0:1788726063.230732:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788726063.230739:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791549184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230776:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791549184:12345-0@lo:400:kworker.0 Request processed in 36us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726063.230781:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788726063.230792:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788726063.230798:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791549696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230825:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791549696:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726063.230830:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788726063.230883:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791549696:0@lo:400:kworker.0 00010000:00080000:2.0:1788726063.230896:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b12833bce00 x1875614791549568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726063.230905:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791549568:0@lo:400:kworker.0 00000100:00100000:2.0:1788726063.230946:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791549184:0@lo:400:kworker.0 00010000:00080000:2.0:1788726063.230957:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b12833bf800 x1875614791550080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726063.230967:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791550080:0@lo:400:kworker.0 00000100:00100000:3.0:1788726063.231072:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791549312:0@lo:8:kworker.0 00000400:00000100:3.0:1788726063.231099:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791549312 offset 0 length 520: 4 00000100:00100000:3.0:1788726063.231163:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791549440:0@lo:8:kworker.0 00000400:00000100:3.0:1788726063.231181:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791549440 offset 0 length 520: 4 00000100:00100000:3.0:1788726063.231192:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791549824:0@lo:8:kworker.0 00000400:00000100:3.0:1788726063.231212:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791549824 offset 0 length 520: 4 00000100:00100000:3.0:1788726063.231220:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791549952:0@lo:8:kworker.0 00000400:00000100:3.0:1788726063.231236:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875614791549952 offset 0 length 520: 4 00010000:00010000:1.0:1788726064.059337:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726064.253509:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726064.253530:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791550208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788726064.253595:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726064.253641:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550208 00000100:00100000:2.0:1788726064.253648:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550208 00000100:00100000:2.0:1788726064.253702:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726064.253711:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791550208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788726064.253743:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726064.253786:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791550208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726064.253792:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726064.253834:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791550208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788726064.254428:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788726064.254463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791550336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788726064.254498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726064.254533:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550336 00000100:00100000:3.0:1788726064.254537:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550336 00000100:00100000:3.0:1788726064.254569:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726064.254577:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791550336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788726064.254598:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788726064.254637:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875614791550336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726064.254642:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726064.254688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791550336:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788726064.773087:0:17866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788726065.083333:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726065.148984:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788726066.112683:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726067.131218:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788726067.761696:0:18636:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788726067.761702:0:18636:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788726067.761703:0:18636:0:(obd_mount.c:940:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788726067.761933:0:18636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b139d94a800 00000020:01000004:2.0:1788726067.761948:0:18636:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788726067.761962:0:18636:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788726067.761977:0:18636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b13a96d3370) 00000020:00000080:2.0:1788726067.761994:0:18636:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788726067.832093:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788726067.833277:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788726067.833767:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788726067.834180:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788726067.834775:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788726067.835063:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788726067.835422:0:18636:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788726067.838792:0:18636:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788726067.839080:0:18636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788726067.839097:0:18636:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788726067.839108:0:18636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13c582691d38179 00000020:01000004:2.0:1788726067.839494:0:18636:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788726067.839519:0:18636:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788726067.839523:0:18636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788726067.839528:0:18636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788726067.839814:0:18636:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788726067.839827:0:18636:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b13a96d4d28) 00000020:00000080:2.0:1788726067.839850:0:18636:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788726067.843025:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726067.843247:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788726067.843607:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788726067.846379:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788726067.846390:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788726067.859195:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788726067.859207:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788726067.861054:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726067.861687:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788726067.861694:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788726067.862751:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788726067.862760:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788726067.894979:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788726067.895489:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788726067.895497:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788726067.897672:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788726067.897687:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788726067.902020:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788726067.902036:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788726067.906313:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788726067.906920:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788726067.906927:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788726067.908097:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788726067.908106:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788726067.973763:0:18636:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788726067.973956:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788726067.973963:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788726067.975655:0:18636:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788726067.975666:0:18636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788726067.976436:0:18636:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788726067.976463:0:18636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788726067.976469:0:18636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788726067.987557:0:18636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788726067.987596:0:18636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788726067.987602:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788726067.987603:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788726067.987604:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726067.987606:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726067.987607:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726067.987609:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726067.987610:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726067.987612:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726067.987619:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726067.987622:0:18636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788726067.987625:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788726067.987626:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788726067.987627:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726067.987627:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726067.987628:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726067.987629:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726067.987630:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726067.987631:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726067.987632:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788726067.987667:0:18636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788726067.987687:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788726067.987753:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726067.987849:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13958d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788726067.987892:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550464 00000100:00100000:1.0:1788726067.987899:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550464 00000100:00100000:1.0:1788726067.987997:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788726067.988015:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:18636:x1875614791550464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788726067.988064:0:17127:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788726067.988067:0:17127:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788726067.988071:0:17127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788726067.988695:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:18636:x1875614791550464:12345-0@lo:253:mount.lustre.0 Request processed in 680us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726067.988704:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788726067.988775:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788726067.988786:0:18636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788726067.988789:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788726067.988791:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788726067.988792:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726067.988793:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726067.988794:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726067.988795:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726067.988796:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726067.988797:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726067.988798:0:18636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788726067.988814:0:18636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b139d94a800 from lustre-OST0000 10000000:01000000:0.0:1788726067.988849:0:18636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788726067.988852:0:18636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788726067.988859:0:18636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b128252b370 local copy 00010000:00010000:0.0:1788726067.988868:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726067.988944:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726067.988981:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726067.989150:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726067.989437:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550592 00000100:00100000:2.0:1788726067.989443:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550592 00000100:00100000:2.0:1788726067.989469:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788726067.989477:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:18636:x1875614791550592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726067.989554:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:18636:x1875614791550592:12345-0@lo:501:mount.lustre.0 Request processed in 77us (572us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788726067.989561:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788726067.989683:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550592:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788726067.989697:0:18636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788726067.989715:0:18636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788726067.989721:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.989730:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726067.989753:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b139d94a800 10000000:01000000:0.0:1788726067.989758:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788726067.989762:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788726067.989765:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788726067.989769:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788726067.989772:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788726067.989793:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.989802:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.989812:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726067.989826:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726067.989853:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726067.989885:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788726067.989934:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550720 00000100:00100000:2.0:1788726067.989939:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550720 00000100:00100000:2.0:1788726067.990002:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788726067.990009:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+18:18636:x1875614791550720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726067.990027:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726067.990045:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13be9a7800/0xa13c582691d3818e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38187 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.990064:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13be9a7800/0xa13c582691d3818e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38187 expref: 19 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.990074:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13be9a7800/0xa13c582691d3818e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38187 expref: 19 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726067.990082:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7800, rc 0) 00000100:00100000:2.0:1788726067.990141:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791550720:12345-0@lo:101:mount.lustre.0 Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726067.990147:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788726067.990233:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726067.990245:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3818e expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726067.990264:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d3818e expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726067.991971:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788726067.992832:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726067.994966:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788726067.995010:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788726067.995023:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788726068.000627:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788726068.000667:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788726068.000706:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788726068.000737:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788726068.000743:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788726068.000842:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726068.000905:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.001002:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.003545:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550848 00000100:00100000:1.0:1788726068.003559:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550848 00000100:00100000:1.0:1788726068.003619:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788726068.003630:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791550848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726068.003878:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791550848:12345-0@lo:501:mount.lustre.0 Request processed in 249us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.003886:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788726068.004440:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726068.004487:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726068.004541:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.004616:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726068.004658:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791550976 00000100:00100000:3.0:1788726068.004663:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791550976 00000100:00100000:3.0:1788726068.004741:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788726068.004751:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791550976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726068.005697:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791550976:12345-0@lo:503:mount.lustre.0 Request processed in 943us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.005706:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788726068.005788:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791550976:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726068.006263:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726068.006334:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726068.006383:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.007742:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.007800:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551104 00000100:00100000:1.0:1788726068.007808:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551104 00000100:00100000:1.0:1788726068.007847:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788726068.007856:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791551104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726068.008560:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791551104:12345-0@lo:502:mount.lustre.0 Request processed in 701us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.008569:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788726068.008699:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726068.008889:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788726068.008922:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788726068.008939:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788726068.008955:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788726068.008968:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788726068.008980:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788726068.008994:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788726068.009008:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788726068.009036:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788726068.009052:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788726068.009066:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788726068.009081:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788726068.009157:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726068.009486:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.009514:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.009665:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551232 00000100:00100000:1.0:1788726068.009671:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551232 00000100:00100000:1.0:1788726068.009702:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788726068.009710:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791551232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726068.009806:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791551232:12345-0@lo:502:mount.lustre.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.009823:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788726068.009958:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726068.010005:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788726068.010013:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788726068.011622:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788726068.011633:0:18653:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788726068.011651:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726068.011653:0:18653:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788726068.011659:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788726068.011674:0:18653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b13bd5b99b8) 00000020:00000080:1.0:1788726068.011711:0:18653:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788726068.011718:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788726068.011793:0:18653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139d94a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788726068.011802:0:18653:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788726068.011810:0:18653:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa13c582691d3819c 00010000:00010000:0.0:1788726068.029564:0:18653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788726068.030010:0:18653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788726068.032489:0:18653:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788726068.034725:0:18653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788726068.034736:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726068.034743:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034745:0:18653:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788726068.034749:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788726068.034759:0:18653:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788726068.034761:0:18653:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726068.034763:0:18653:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788726068.034764:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788726068.034767:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034768:0:18653:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788726068.034771:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726068.034773:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034775:0:18653:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788726068.034778:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788726068.034780:0:18653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788726068.034782:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726068.034784:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034786:0:18653:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788726068.034788:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788726068.034790:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034791:0:18653:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788726068.034794:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788726068.034821:0:18653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788726068.034824:0:18653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788726068.034826:0:18653:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788726068.034829:0:18653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788726068.034992:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788726068.035381:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788726068.035403:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3818e expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.035415:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a9000/0xa13c582691d38187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d3818e expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726068.035422:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139d94a800 from 1 10000000:01000000:1.0:1788726068.035425:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788726068.035460:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.035468:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.035479:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726068.035513:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788726068.035576:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726068.035613:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788726068.035790:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551360 00000100:00100000:2.0:1788726068.035798:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551360 00000100:00100000:2.0:1788726068.035847:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788726068.035856:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:18636:x1875614791551360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726068.035869:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726068.035880:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d381a3 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.035904:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d381a3 expref: 20 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.035914:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381a3 expref: 20 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.035923:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7e00, rc 0) 00000100:00100000:2.0:1788726068.035968:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551360:12345-0@lo:101:mount.lustre.0 Request processed in 113us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.035984:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788726068.036390:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726068.036405:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.036413:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726068.042771:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788726068.044085:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726068.044341:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788726068.044366:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788726068.044385:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788726068.044391:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788726068.044468:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726068.044534:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.044584:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726068.045156:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551488 00000100:00100000:2.0:1788726068.045172:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551488 00000100:00100000:2.0:1788726068.045228:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788726068.045237:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726068.045497:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551488:12345-0@lo:501:mount.lustre.0 Request processed in 258us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.045504:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788726068.045705:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726068.045743:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726068.045877:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.045912:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726068.045959:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551616 00000100:00100000:2.0:1788726068.045964:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551616 00000100:00100000:2.0:1788726068.045996:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788726068.046003:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726068.046095:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551616:12345-0@lo:503:mount.lustre.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.046101:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788726068.046534:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788726068.046928:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788726068.046996:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726068.047558:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726068.047588:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726068.047667:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551744 00000100:00100000:2.0:1788726068.047673:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551744 00000100:00100000:2.0:1788726068.047749:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788726068.047758:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726068.047864:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551744:12345-0@lo:502:mount.lustre.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.047872:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788726068.047941:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788726068.048153:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788726068.048202:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788726068.048221:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788726068.048237:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788726068.048698:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788726068.048719:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788726068.048735:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788726068.048749:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788726068.048777:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788726068.048792:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788726068.048806:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788726068.048835:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726068.048883:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726068.049619:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791551872 00000100:00100000:1.0:1788726068.049626:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791551872 00000100:00100000:1.0:1788726068.049675:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788726068.049685:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726068.049787:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791551872:12345-0@lo:502:mount.lustre.0 Request processed in 102us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.049795:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788726068.051453:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788726068.051491:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791551872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726068.051585:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788726068.051598:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788726068.052687:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726068.052698:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052701:0:18657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788726068.052707:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139d94a800 00000020:00000080:2.0:1788726068.052715:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726068.052723:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726068.052725:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052727:0:18657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788726068.052729:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726068.052732:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052733:0:18657:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788726068.052737:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b139d94a800 00000020:00000080:2.0:1788726068.052739:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726068.052794:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726068.052798:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052799:0:18657:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788726068.052801:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726068.052804:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052805:0:18657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788726068.052808:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139d94a800 00000020:00000080:2.0:1788726068.052810:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726068.052827:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726068.052829:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052831:0:18657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788726068.052832:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788726068.052835:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052836:0:18657:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788726068.052839:0:18657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b139d94a800 00000020:00000080:2.0:1788726068.052841:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788726068.052861:0:18657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788726068.052865:0:18657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726068.052866:0:18657:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788726068.052869:0:18657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788726068.058580:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788726068.058629:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726068.058661:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.058685:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726068.058739:0:18636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788726068.058742:0:18636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b139d94a800 10000000:01000000:2.0:1788726068.058745:0:18636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b139d94a800 10000000:01000000:2.0:1788726068.058749:0:18636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726068.058754:0:18636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b139d94a800 from 1 10000000:01000000:2.0:1788726068.058757:0:18636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788726068.058791:0:18636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.058799:0:18636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.058810:0:18636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726068.058834:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726068.058897:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726068.058936:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13be972600 going to sleep for 11 seconds 00000100:00100000:1.0:1788726068.059019:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552000 00000100:00100000:1.0:1788726068.059027:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552000 00000100:00100000:1.0:1788726068.059074:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788726068.059085:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:18636:x1875614791552000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726068.059098:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726068.059133:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e800/0xa13c582691d381b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d381b1 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.059156:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e800/0xa13c582691d381b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d381b1 expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.059187:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e800/0xa13c582691d381b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381b1 expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.059206:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e800, rc 0) 00000100:00100000:1.0:1788726068.059413:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552000:12345-0@lo:101:mount.lustre.0 Request processed in 162us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.059422:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788726068.059654:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726068.059668:0:18636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381b8 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.059677:0:18636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d381b8 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726068.064848:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788726068.065479:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726068.065707:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788726068.065734:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788726068.065751:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788726068.065766:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788726068.065780:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788726068.065793:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788726068.065806:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788726068.065820:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788726068.065852:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788726068.065870:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788726068.065884:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788726068.065897:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788726068.065910:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788726068.065922:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788726068.065934:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788726068.065948:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788726068.065962:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788726068.065976:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788726068.065989:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788726068.066004:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788726068.066031:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788726068.066049:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788726068.066061:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788726068.066074:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788726068.066100:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788726068.066150:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788726068.066165:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788726068.066190:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788726068.066215:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788726068.066228:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788726068.066241:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788726068.066652:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788726068.066684:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788726068.066698:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788726068.066713:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788726068.066726:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788726068.066739:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788726068.066763:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788726068.066770:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788726068.066882:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726068.066945:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.066993:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726068.073375:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552128 00000100:00100000:0.0:1788726068.073389:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552128 00000100:00100000:0.0:1788726068.073457:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788726068.073467:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726068.073629:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552128:12345-0@lo:501:mount.lustre.0 Request processed in 164us (6684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726068.073660:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788726068.074104:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726068.074565:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726068.074621:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.074666:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726068.075376:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552256 00000100:00100000:3.0:1788726068.075386:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552256 00000100:00100000:3.0:1788726068.075429:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788726068.075439:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726068.075551:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552256:12345-0@lo:503:mount.lustre.0 Request processed in 113us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.075559:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788726068.075613:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788726068.075997:0:18636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788726068.077487:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726068.077556:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.077605:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552384 00000100:00100000:3.0:1788726068.077617:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552384 00000100:00100000:3.0:1788726068.077671:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788726068.077681:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726068.077778:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552384:12345-0@lo:502:mount.lustre.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.077785:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788726068.077836:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726068.077857:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726068.078047:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788726068.078076:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788726068.078091:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788726068.078105:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788726068.078141:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788726068.078156:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788726068.078180:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788726068.078195:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788726068.078209:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788726068.078222:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788726068.079096:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788726068.079149:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788726068.079419:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788726068.079439:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788726068.079451:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788726068.079462:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788726068.079473:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788726068.079485:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788726068.079495:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788726068.079506:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788726068.079516:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788726068.079526:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788726068.079549:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788726068.079561:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788726068.079571:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788726068.079582:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788726068.079605:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788726068.079617:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788726068.079628:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788726068.079651:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788726068.079664:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788726068.079676:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788726068.079687:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788726068.079698:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788726068.079709:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788726068.079721:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788726068.079732:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788726068.079744:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788726068.079756:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788726068.079769:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788726068.079781:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788726068.079794:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788726068.079822:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788726068.079838:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788726068.079850:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788726068.079863:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788726068.079877:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788726068.079890:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788726068.079940:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726068.080002:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.081375:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498180 going to sleep for 11 seconds 00000100:00100000:0.0:1788726068.081622:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552512 00000100:00100000:0.0:1788726068.081632:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552512 00000100:00100000:0.0:1788726068.081696:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788726068.081705:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726068.081839:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552512:12345-0@lo:502:mount.lustre.0 Request processed in 135us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726068.081848:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788726068.083756:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726068.083976:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788726068.084009:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788726068.084057:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726068.084137:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.084339:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552640 00000100:00100000:3.0:1788726068.084345:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552640 00000100:00100000:3.0:1788726068.084388:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788726068.084397:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726068.084491:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791552640:12345-0@lo:502:mount.lustre.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.084498:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788726068.084544:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726068.084556:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791552640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726068.084591:0:18636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788726068.084599:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788726068.092459:0:18662:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788726068.092476:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b139e434d28) 00000020:00000080:0.0:1788726068.092498:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788726068.092588:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139d94a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788726068.092593:0:18662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139d94a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788726068.092595:0:18662:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139d94a800 3 00010000:00080000:0.0:1788726068.092644:0:18662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b12824fc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788726068.100332:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788726068.100549:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788726068.100592:0:18662:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788726068.100604:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa13c582691d381c6 00000100:00080000:0.0:1788726068.100614:0:18662:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788726068.100619:0:18662:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b12824fc800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788726068.100663:0:18662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1282599f80 x1875614791552768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788726068.100684:0:18662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788726068.105624:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791552768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788726068.105712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.105894:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552768 00000100:00100000:3.0:1788726068.105902:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552768 00000100:00100000:3.0:1788726068.105932:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726068.105939:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1875614791552768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788726068.105965:0:17133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1788726068.105996:0:17133:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa13c582691d381cd 00000004:00100000:3.0:1788726068.106011:0:17133:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788726068.106041:0:17133:0:(import.c:65:import_set_state_nolock()) ffff9b13be5cb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726068.106086:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875614791552768:12345-0@lo:38:llog_process_th.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.106101:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788726068.106159:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1282599f80 x1875614791552768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:1.0:1788726068.107379:0:18662:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788726068.107396:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9b1384b519b8) 00000020:00000080:1.0:1788726068.107419:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788726068.107510:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b139d94a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788726068.107515:0:18662:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b139d94a800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788726068.107518:0:18662:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b139d94a800 3 00010000:00080000:1.0:1788726068.107544:0:18662:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b1282503800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788726068.109185:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788726068.109362:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788726068.109402:0:18662:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726068.109415:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa13c582691d381db 00000100:00080000:1.0:1788726068.109425:0:18662:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726068.109431:0:18662:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9b1282503800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726068.109467:0:18662:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283758700 x1875614791552896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726068.109483:0:18662:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788726068.109798:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726068.109809:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788726068.109817:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788726068.109821:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788726068.109824:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b12824fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788726068.109831:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1875614791552768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788726068.109858:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791552896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788726068.109920:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.110922:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791552896 00000100:00100000:3.0:1788726068.110934:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791552896 00000100:00100000:3.0:1788726068.110981:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726068.110988:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791552896:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788726068.111014:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:3.0:1788726068.111044:0:17135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa13c582691d381e2 00000004:00100000:3.0:1788726068.111060:0:17135:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788726068.111089:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b13be5cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788726068.111179:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875614791552896:12345-0@lo:38:llog_process_th.0 Request processed in 177us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.111186:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788726068.111239:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b1283758700 x1875614791552896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788726068.111384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726068.111389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726068.111392:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726068.111394:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726068.111419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726068.111422:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726068.111424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726068.111427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788726068.111467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791553408:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726068.111520:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726068.111526:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791553024:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726068.111578:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791553152:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726068.111617:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788726068.111622:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791553280:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726068.111703:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553024 00000100:00100000:2.0:1788726068.111707:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553024 00000100:00100000:2.0:1788726068.111734:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553280 00000100:00100000:2.0:1788726068.111738:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553280 00000100:00100000:2.0:1788726068.111751:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788726068.111763:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791553024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111801:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791553024:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.111808:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788726068.111820:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788726068.111826:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791553280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111855:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791553280:12345-0@lo:400:kworker.0 Request processed in 29us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.111861:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788726068.111887:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791553024:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.111908:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791553280:0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.112470:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553408 00000100:00100000:2.0:1788726068.112476:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553408 00000100:00100000:2.0:1788726068.112501:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553152 00000100:00100000:2.0:1788726068.112504:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553152 00000100:00100000:2.0:1788726068.112517:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726068.112523:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791553408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.112560:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791553408:12345-0@lo:400:kworker.0 Request processed in 37us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.112566:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726068.112578:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726068.112584:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791553152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726068.112611:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791553152:12345-0@lo:400:kworker.0 Request processed in 27us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.112616:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788726068.112669:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b12833bf100 x1875614791553408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726068.112680:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791553408:0@lo:400:kworker.0 00010000:00080000:2.0:1788726068.112701:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b12833bce00 x1875614791553152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726068.112710:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791553152:0@lo:400:kworker.0 00000100:00100000:3.0:1788726068.113436:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726068.113446:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788726068.113454:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788726068.113458:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788726068.113462:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1282503800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788726068.113469:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1875614791552896:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788726068.120829:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788726068.120976:0:18636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788726068.121008:0:18636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788726068.121033:0:18636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381b8 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.121046:0:18636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7400/0xa13c582691d381b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381b8 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788726068.121093:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788726068.121096:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788726068.121097:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726068.121099:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726068.121100:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726068.121102:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726068.121103:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726068.121105:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726068.121106:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788726068.121110:0:18636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788726068.121113:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788726068.121137:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788726068.121138:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726068.121139:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726068.121140:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726068.121141:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726068.121142:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726068.121148:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726068.121149:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788726068.121185:0:18636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788726068.121213:0:18636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791553536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788726068.121385:0:18636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726068.121446:0:18636:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283498900 going to sleep for 11 seconds 00000100:00100000:0.0:1788726068.121548:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553536 00000100:00100000:0.0:1788726068.121556:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553536 00000100:00100000:0.0:1788726068.121605:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788726068.121615:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791553536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788726068.121653:0:17127:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788726068.121668:0:17127:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788726068.130687:0:17127:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788726068.130706:0:17127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788726068.130877:0:17149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788726068.130883:0:17149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788726068.130906:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.130924:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3812c expref: 21 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.130932:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3813a expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.130940:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.130979:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 21 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.130994:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 21 pid: 17127 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726068.131008:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791553664:0@lo:104: 00000100:00100000:0.0:1788726068.131072:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788726068.131146:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 21 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726068.131154:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 21 pid: 17126 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726068.131190:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791553792:0@lo:104: 00000100:00100000:2.0:1788726068.131365:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553664 00000100:00100000:2.0:1788726068.131373:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553664 00000100:00100000:2.0:1788726068.131419:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726068.131428:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791553664:12345-0@lo:104: 00010000:00010000:2.0:1788726068.131440:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726068.131492:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726068.131499:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791553664:12345-0@lo:104: Request processed in 73us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.131506:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726068.131701:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726068.131817:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726068.131824:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.131841:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f400 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788726068.131845:0:17121:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.131853:0:17121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726068.131860:0:17121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726068.131866:0:17121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788726068.131894:0:17121:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.131901:0:17121:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726068.131920:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.131927:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949f400/0xa13c582691d3813a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38141 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.131940:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726068.131941:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726068.131943:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726068.131965:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791553920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726068.131993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726068.132039:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553920 00000100:00100000:1.0:1788726068.132043:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553920 00010000:00010000:1.0:1788726068.132061:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 22 pid: 17127 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726068.132089:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726068.132097:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3641:x1875614791553920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726068.132106:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726068.132112:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 22 pid: 17127 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.132148:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 22 pid: 17127 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.132174:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726068.132213:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3641:x1875614791553920:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.132220:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726068.132387:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:18636:x1875614791553536:12345-0@lo:253:mount.lustre.0 Request processed in 10773us (11001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726068.132396:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788726068.132484:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13855f0f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788726068.132502:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1384c8f800/0xa13c582691d38141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d3813a expref: 20 pid: 17127 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726068.132513:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791553664:0@lo:104: 00000100:00100000:1.0:1788726068.132550:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791553920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726068.132780:0:17116:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788726068.132791:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791553792 00000100:00100000:3.0:1788726068.132795:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791553792 00000100:00100000:3.0:1788726068.132867:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788726068.132876:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791553792:12345-0@lo:104: 00010000:00010000:3.0:1788726068.132886:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726068.132947:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726068.132954:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791553792:12345-0@lo:104: Request processed in 80us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726068.132960:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726068.133034:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791553792:0@lo:104: 00010000:00010000:0.0:1788726068.133051:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133096:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726068.133102:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133109:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:1.0:1788726068.133201:0:18289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133212:0:18289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788726068.133219:0:18289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726068.133237:0:18289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788726068.133273:0:18289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133279:0:18289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788726068.133298:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133305:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13be9a7200/0xa13c582691d3812c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38133 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133318:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726068.133319:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726068.133321:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726068.133331:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791554048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788726068.133362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726068.133396:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554048 00000100:00100000:1.0:1788726068.133399:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554048 00010000:00010000:1.0:1788726068.133414:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 20 pid: 17126 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726068.133434:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726068.133441:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13881e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:3638:x1875614791554048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726068.133450:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726068.133455:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 20 pid: 17126 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133464:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 20 pid: 17126 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133482:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1384c8ee00/0xa13c582691d38133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d3812c expref: 20 pid: 17126 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133494:0:17118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133502:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788726068.133513:0:17118:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006948171s 00010000:00010000:1.0:1788726068.133517:0:17118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133524:0:17118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133530:0:17118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133536:0:17118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133541:0:17118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788726068.133546:0:17118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133553:0:17118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133566:0:17118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133580:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726068.133608:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13881e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:3638:x1875614791554048:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726068.133615:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788726068.133666:0:17149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133674:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726068.133681:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13af8a9200/0xa13c582691d381e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726068.133705:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791554048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726068.134541:0:18636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:18636:1875614791553536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788726068.134554:0:18636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788726068.134557:0:18636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788726068.134559:0:18636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788726068.134560:0:18636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788726068.134562:0:18636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788726068.134563:0:18636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788726068.134564:0:18636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788726068.134566:0:18636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788726068.134568:0:18636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788726068.134569:0:18636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788726068.134581:0:18636:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1788726068.136381:0:18636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788726068.139085:0:18636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788726068.139095:0:18636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788726068.139477:0:18636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788726068.139518:0:18636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788726068.139535:0:18636:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788726068.139557:0:18636:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788726068.140460:0:18636:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788726068.140681:0:18636:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788726068.164605:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788726069.141350:0:18717:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788726069.141604:0:18717:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788726069.185009:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726069.371234:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791554176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788726069.371299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726069.371353:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554176 00000100:00100000:2.0:1788726069.371359:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554176 00000100:00100000:2.0:1788726069.371399:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788726069.371408:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791554176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788726069.371444:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726069.371486:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791554176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726069.371493:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788726069.371535:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791554176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726069.375872:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791554304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726069.375943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726069.378296:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554304 00000100:00100000:1.0:1788726069.378309:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554304 00000100:00100000:1.0:1788726069.378354:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788726069.378364:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791554304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788726069.378399:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788726069.378467:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791554304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726069.378474:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788726069.379010:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791554304:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788726070.011256:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788726070.011264:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139e73e000 from 9 10000000:01000000:0.0:1788726070.011269:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788726070.011316:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.011327:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.011339:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726070.011382:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726070.011449:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726070.011880:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13958d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788726070.014844:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554432 00000100:00100000:1.0:1788726070.014858:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554432 00000100:00100000:1.0:1788726070.014929:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788726070.014940:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+19:17131:x1875614791554432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726070.014974:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726070.014995:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d381f0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.015025:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d381f0 expref: 20 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.015038:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381f0 expref: 20 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.015048:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f000, rc 0) 00000100:00100000:1.0:1788726070.015143:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:17131:x1875614791554432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.015152:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788726070.015374:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788726070.015395:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726070.015405:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726070.015467:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788726070.015579:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726070.015655:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13958d7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726070.015750:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554560 00000100:00100000:3.0:1788726070.015756:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554560 00000100:00100000:3.0:1788726070.015838:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788726070.015847:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:17131:x1875614791554560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788726070.015864:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788726070.015881:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788726070.015885:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788726070.015969:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:17131:x1875614791554560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726070.015977:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788726070.018588:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282599c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788726070.018707:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788726070.018719:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.018730:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788726070.018740:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788726070.018742:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b1283ea8000 from 9 10000000:01000000:1.0:1788726070.018744:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788726070.018779:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.018788:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.018808:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726070.018832:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788726070.018900:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726070.018965:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13862d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788726070.018994:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554688 00000100:00100000:1.0:1788726070.019002:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554688 00000100:00100000:1.0:1788726070.019060:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788726070.019073:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:17131:x1875614791554688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726070.019088:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726070.019101:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d381fe expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.019148:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d381fe expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.019158:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381fe expref: 21 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.019166:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949ec00, rc 0) 00000100:00100000:1.0:1788726070.019204:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791554688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.019210:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788726070.019249:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726070.019262:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.019276:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726070.020599:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788726070.020660:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726070.020677:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13862d3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726070.020966:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554816 00000100:00100000:3.0:1788726070.020974:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554816 00000100:00100000:1.0:1788726070.021205:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788726070.021215:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791554816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788726070.021236:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788726070.021259:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788726070.021262:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788726070.021365:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791554816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726070.021373:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788726070.021415:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791554816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788726070.021480:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788726070.021490:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.021500:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726070.208077:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726071.227802:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788726071.745260:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788726072.257527:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726073.277889:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788726073.468925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726073.468932:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726073.468935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726073.468938:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726073.468954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726073.468957:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726073.468971:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726073.468975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788726073.469016:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791555072:0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726073.469156:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791555584:0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726073.469203:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788726073.469209:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791555200:0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469229:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726073.469244:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791555712:0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726073.469293:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555072 00000100:00100000:3.0:1788726073.469301:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555072 00000100:00100000:3.0:1788726073.469340:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788726073.469351:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791555072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469402:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791555072:12345-0@lo:400:kworker.0 Request processed in 53us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726073.469409:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788726073.469430:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555584 00000100:00100000:3.0:1788726073.469433:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555584 00000100:00100000:3.0:1788726073.469462:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555200 00000100:00100000:3.0:1788726073.469465:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555200 00000100:00100000:3.0:1788726073.469475:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555712 00000100:00100000:3.0:1788726073.469478:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555712 00000100:00100000:3.0:1788726073.469492:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788726073.469497:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.469537:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791555584:12345-0@lo:400:kworker.0 Request processed in 40us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726073.469543:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726073.469616:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791554944:0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726073.469672:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791555456:0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726073.469709:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726073.469713:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791555328:0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726073.469759:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791554944 00000100:00100000:0.0:1788726073.469763:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791554944 00000100:00100000:0.0:1788726073.469797:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788726073.469803:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:3641:x1875614791554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469837:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:3641:x1875614791554944:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.469850:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788726073.469877:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555328 00000100:00100000:0.0:1788726073.469881:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555328 00000100:00100000:0.0:1788726073.469903:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788726073.469909:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791555328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469939:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791555328:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.469944:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788726073.469974:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791555328:0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.469982:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791554944:0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.470200:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555456 00000100:00100000:0.0:1788726073.470205:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555456 00000100:00100000:0.0:1788726073.470224:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726073.470230:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791555200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.470262:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791555200:12345-0@lo:400:kworker.0 Request processed in 32us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.470268:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726073.470279:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788726073.470285:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791555712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.470309:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875614791555712:12345-0@lo:400:kworker.0 Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.470315:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788726073.470325:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788726073.470331:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791555456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726073.470376:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875614791555456:12345-0@lo:400:kworker.0 Request processed in 46us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726073.470382:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788726073.470409:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b128346d880 x1875614791555456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726073.470419:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875614791555456:0@lo:400:kworker.0 00000100:00080000:3.0:1788726073.472247:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788726073.472255:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788726073.472294:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b128346d500 x1875614791555200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726073.472310:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791555200:0@lo:400:kworker.0 00010000:00080000:3.0:1788726073.472322:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db7800 x1875614791555712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726073.472330:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1875614791555712:0@lo:400:kworker.0 00000100:00100000:3.0:1788726073.472342:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791555072:0@lo:400:kworker.0 00010000:00080000:3.0:1788726073.472352:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db5f80 x1875614791555584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726073.472360:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791555584:0@lo:400:kworker.0 00010000:00010000:2.0:1788726074.299315:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788726074.403937:0:19006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788726074.493270:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791555840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726074.493339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726074.493402:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555840 00000100:00100000:0.0:1788726074.493410:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555840 00000100:00100000:2.0:1788726074.493434:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791555968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726074.493458:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788726074.493469:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791555840:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788726074.493473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788726074.493508:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788726074.493513:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791555968 00000100:00100000:2.0:1788726074.493519:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791555968 00000100:00100000:2.0:1788726074.493546:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788726074.493555:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791555968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726074.493559:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791555840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726074.493568:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00000024:2.0:1788726074.493576:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726074.493626:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791555968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726074.493633:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788726074.493674:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791555968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788726074.493703:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791555840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788726075.326827:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726075.388938:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788726075.440911:0:19058:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788726075.441836:0:19058:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788726076.347441:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788726076.521503:0:19109:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788726076.521737:0:19109:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788726077.371362:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726078.336619:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726063/real 1788726063] req@ffff9b12833bd500 x1875614791549824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726078 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726078.336663:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b12833bd500 x1875614791549824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726078 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726078.336700:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726063/real 1788726063] req@ffff9b12833bea00 x1875614791549952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726078 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726078.336713:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b12833bea00 x1875614791549952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726078 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788726078.336741:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788726078.336823:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788726078.336829:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791549824:0@lo:8:kworker.0 00000100:00080000:2.0:1788726078.336836:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788726078.339715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.339725:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726078.339728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.339731:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726078.339764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.339768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788726078.339772:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b13842be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726078.339794:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1788726078.339800:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788726078.339808:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9b13842be800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726078.339836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283db4000 x1875614791556608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726078.339849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.339852:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788726078.339854:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726078.339858:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1788726078.339860:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788726078.339865:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b139116b000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726078.339876:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283db4700 x1875614791556736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788726078.339932:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791556096:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.340025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.340086:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791556864:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.342973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343036:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788726078.343051:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791556224:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.343089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343139:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791556992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.343163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343201:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791556352:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.343226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343258:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791557120:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.343283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343296:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726078.343301:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791556480:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.343324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.343371:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556096 00000100:00100000:3.0:1788726078.343383:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556096 00000100:00100000:3.0:1788726078.344237:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788726078.344255:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:3638:x1875614791556096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344339:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:3638:x1875614791556096:12345-0@lo:400:kworker.0 Request processed in 89us (4313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.344346:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788726078.344391:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556864 00000100:00100000:3.0:1788726078.344398:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556864 00000100:00100000:3.0:1788726078.344496:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556992 00000100:00100000:3.0:1788726078.344501:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556992 00000100:00100000:3.0:1788726078.344528:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556352 00000100:00100000:3.0:1788726078.344531:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556352 00000100:00100000:3.0:1788726078.344543:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557120 00000100:00100000:3.0:1788726078.344546:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557120 00000100:00100000:3.0:1788726078.344561:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726078.344576:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791556864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344612:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791556864:12345-0@lo:400:kworker.0 Request processed in 45us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.344618:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726078.344631:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788726078.344637:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791556992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344664:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791556992:12345-0@lo:400:kworker.0 Request processed in 27us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.344684:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788726078.344696:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788726078.344701:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791556352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344732:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791556352:12345-0@lo:400:kworker.0 Request processed in 31us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.344738:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788726078.344749:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788726078.344755:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791557120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344782:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791557120:12345-0@lo:400:kworker.0 Request processed in 27us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.344788:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788726078.344806:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788726078.344811:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788726078.344847:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db6d80 x1875614791556352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.344865:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791556352:0@lo:400:kworker.0 00010000:00080000:3.0:1788726078.344877:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db7100 x1875614791557120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.344887:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791557120:0@lo:400:kworker.0 00010000:00080000:3.0:1788726078.344927:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db4e00 x1875614791556992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.344936:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791556992:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.344946:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791556096:0@lo:400:kworker.0 00010000:00080000:3.0:1788726078.344965:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db6a00 x1875614791556864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.344975:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791556864:0@lo:400:kworker.0 00000100:00080000:2.0:1788726078.346247:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788726078.346261:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791549952:0@lo:8:kworker.0 00000100:00100000:2.0:1788726078.346306:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791556608:0@lo:8:kworker.0 00000100:00100000:2.0:1788726078.346382:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726078.346459:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791556736:0@lo:8:kworker.0 00000100:00100000:2.0:1788726078.346488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726078.346536:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556224 00000100:00100000:2.0:1788726078.346545:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556224 00000100:00100000:2.0:1788726078.346602:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556480 00000100:00100000:2.0:1788726078.346606:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556480 00000100:00100000:2.0:1788726078.346625:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788726078.346635:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791556224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726078.346697:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791556224:12345-0@lo:400:kworker.0 Request processed in 62us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726078.346704:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788726078.346721:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788726078.346737:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791556480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726078.346773:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791556480:12345-0@lo:400:kworker.0 Request processed in 38us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726078.346779:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788726078.346807:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556608 00000100:00100000:2.0:1788726078.346811:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556608 00000100:00100000:2.0:1788726078.346824:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791556736 00000100:00100000:2.0:1788726078.346827:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791556736 00000100:00100000:2.0:1788726078.346835:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726078.346840:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1875614791556608:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788726078.346874:0:18642:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788726078.346912:0:18642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d3820c 00002000:00100000:2.0:1788726078.346932:0:18642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9b1283379800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788726078.346936:0:18642:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788726078.346940:0:18642:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788726078.347239:0:18642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788726078.347271:0:18642:0:(import.c:65:import_set_state_nolock()) ffff9b128337f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726078.347317:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791556608:12345-0@lo:8:kworker.0 Request processed in 475us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726078.347323:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726078.347338:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788726078.347342:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1875614791556736:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788726078.347355:0:18642:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788726078.349381:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791556480:0@lo:400:kworker.0 00000100:00100000:3.0:1788726078.349517:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791556224:0@lo:400:kworker.0 00000100:00080000:3.0:1788726078.349546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.349552:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726078.349555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726078.349559:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788726078.352294:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283db4000 x1875614791556608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.352313:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788726078.352327:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788726078.352340:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788726078.352348:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788726078.352353:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13842be800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788726078.352392:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788726078.352400:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791556608:0@lo:8:kworker.0 00000004:00080000:0.0:1788726078.353702:0:17874:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788726078.353847:0:17874:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 523509728900ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788726078.353856:0:17874:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788726078.356280:0:17875:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788726078.356322:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557376:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788726078.356417:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726078.359171:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726078.359510:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791557248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788726078.359599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726078.363605:0:18643:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788726078.363630:0:18643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788726078.364955:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557248 00000100:00100000:3.0:1788726078.364973:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557248 00000100:00100000:3.0:1788726078.365044:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788726078.365056:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875614791557248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788726078.365101:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788726078.365254:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875614791557248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (5655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726078.365262:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788726078.365320:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283759500 x1875614791557248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.365346:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791557248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788726078.365380:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726078.366845:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557376 00000100:00100000:0.0:1788726078.366857:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557376 00000100:00100000:1.0:1788726078.367772:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726078.367789:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17875:x1875614791557376:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788726078.374105:0:17866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788726078.380641:0:19181:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788726078.380657:0:19181:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788726078.380801:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17875:x1875614791557376:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13011us (24377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726078.380813:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788726078.380927:0:17875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283759c00 x1875614791557376/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788726094 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.380945:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283759c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557376:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788726078.380973:0:17875:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788726078.381027:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557504:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788726078.381074:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.381146:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726078.382285:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557504 00000100:00100000:0.0:1788726078.382299:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557504 00000100:00100000:0.0:1788726078.382382:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788726078.382395:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17875:x1875614791557504:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788726078.382446:0:18643:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788726078.382530:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17875:x1875614791557504:12345-0@lo:5:osp-pre-0-1.0 Request processed in 137us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726078.382537:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788726078.382693:0:17875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be829c00 x1875614791557504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788726094 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.382709:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557504:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788726078.382723:0:17875:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788726078.382771:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557632:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788726078.382803:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.382833:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697600 going to sleep for 11 seconds 00000100:00100000:0.0:1788726078.384309:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557632 00000100:00100000:0.0:1788726078.384328:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557632 00000100:00100000:0.0:1788726078.384405:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788726078.384417:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17875:x1875614791557632:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788726078.384483:0:18643:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788726078.396729:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726078.397229:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1875614791556736:12345-0@lo:8:kworker.0 Request processed in 49878us (50733us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788726078.397263:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788726078.397557:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726078.397574:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788726078.397578:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791556736:0@lo:8:kworker.0 00000001:00080000:3.0:1788726078.426514:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788726078.426537:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788726078.426862:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17875:x1875614791557632:12345-0@lo:5:osp-pre-0-1.0 Request processed in 42441us (44050us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788726078.426874:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788726078.426990:0:17875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be829c00 x1875614791557632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788726094 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.427021:0:17875:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788726078.427031:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17875:1875614791557632:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788726078.427051:0:17875:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788726078.427164:0:17875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17875:1875614791557760:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788726078.427209:0:17875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726078.427244:0:17875:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e697600 going to sleep for 11 seconds 00000100:00100000:2.0:1788726078.427410:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557760 00000100:00100000:2.0:1788726078.427428:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557760 00000100:00100000:2.0:1788726078.427481:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788726078.427492:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17875:x1875614791557760:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788726078.427558:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17875:x1875614791557760:12345-0@lo:900:osp-pre-0-1.0 Request processed in 67us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726078.427564:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788726078.427733:0:17875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be829c00 x1875614791557760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788726094 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726078.427745:0:17875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17875:1875614791557760:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788726079.419954:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726079.614107:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726079.614151:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791557888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788726079.614222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726079.614393:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791558016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788726079.614425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726079.614555:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791557888 00000100:00100000:0.0:1788726079.614576:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791557888 00000100:00100000:0.0:1788726079.614623:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558016 00000100:00100000:0.0:1788726079.614627:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558016 00000100:00100000:0.0:1788726079.614657:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726079.614665:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791557888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788726079.614695:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726079.614742:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791557888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726079.614749:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726079.614766:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788726079.614772:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791558016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788726079.614790:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788726079.614813:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791558016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726079.614819:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788726079.614852:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791558016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726079.614864:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791557888:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788726080.446381:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726081.467314:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788726081.980967:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788726082.495110:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788726083.135611:0:19455:0:(obd_mount.c:934:lmd_print()) mount data: 00000020:01000004:2.0:1788726083.135615:0:19455:0:(obd_mount.c:937:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788726083.135617:0:19455:0:(obd_mount.c:940:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788726083.135724:0:19455:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b1283378800 00000020:01000004:2.0:1788726083.135738:0:19455:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788726083.135768:0:19455:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788726083.135808:0:19455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b1282600000) 00000020:00000080:2.0:1788726083.135827:0:19455:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788726083.244902:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788726083.249357:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788726083.250235:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788726083.250514:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788726083.252402:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788726083.252988:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788726083.253960:0:19455:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788726083.256881:0:19455:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788726083.257385:0:19455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788726083.257402:0:19455:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788726083.257415:0:19455:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13c582691d3821a 00000020:01000004:0.0:1788726083.257423:0:19455:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788726083.257447:0:19455:0:(obd_mount.c:414:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788726083.257451:0:19455:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788726083.257457:0:19455:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788726083.257489:0:19455:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788726083.257493:0:19455:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788726083.270625:0:19455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788726083.270830:0:19455:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788726083.270835:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788726083.270837:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788726083.270839:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726083.270840:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726083.270841:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726083.270842:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726083.270843:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726083.270845:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726083.270847:0:19455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788726083.270850:0:19455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788726083.270853:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788726083.270854:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788726083.270860:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726083.270861:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726083.270862:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726083.270863:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726083.270864:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726083.270865:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726083.270866:0:19455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788726083.270890:0:19455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788726083.270909:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558144:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788726083.270978:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.271089:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a100900 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.271281:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558144 00000100:00100000:0.0:1788726083.271290:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558144 00000100:00100000:0.0:1788726083.271391:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788726083.271401:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:19455:x1875614791558144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788726083.271430:0:17127:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788726083.271433:0:17127:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788726083.271437:0:17127:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788726083.271721:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:19455:x1875614791558144:12345-0@lo:253:mount.lustre.0 Request processed in 321us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.271730:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788726083.271804:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788726083.271814:0:19455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788726083.271817:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788726083.271818:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788726083.271819:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788726083.271820:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788726083.271821:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788726083.271822:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788726083.271823:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788726083.271824:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788726083.271825:0:19455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788726083.271846:0:19455:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b1283378800 from lustre-OST0001 10000000:01000000:2.0:1788726083.271883:0:19455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788726083.271886:0:19455:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788726083.271895:0:19455:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b128252b370 local copy 00010000:00010000:2.0:1788726083.271904:0:19455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.271985:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726083.272017:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.272367:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a100300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726083.272455:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558272 00000100:00100000:3.0:1788726083.272460:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558272 00000100:00100000:3.0:1788726083.272492:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788726083.272500:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:19455:x1875614791558272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726083.272589:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:19455:x1875614791558272:12345-0@lo:501:mount.lustre.0 Request processed in 90us (571us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726083.272596:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788726083.272768:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558272:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788726083.272793:0:19455:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788726083.272812:0:19455:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788726083.272818:0:19455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.272827:0:19455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13a949fc00/0xa13c582691d37f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d37f3b expref: -99 pid: 17112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726083.272851:0:19455:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b1283378800 10000000:01000000:2.0:1788726083.272855:0:19455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788726083.272859:0:19455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788726083.272861:0:19455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726083.272865:0:19455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788726083.272868:0:19455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788726083.272889:0:19455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.272897:0:19455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.272906:0:19455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.272919:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558400:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726083.272949:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.272962:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a100300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726083.273295:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558400 00000100:00100000:3.0:1788726083.273301:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558400 00000100:00100000:3.0:1788726083.273333:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788726083.273341:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:19455:x1875614791558400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788726083.273350:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726083.273362:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8ea00/0xa13c582691d38228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38221 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.273382:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8ea00/0xa13c582691d38228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38221 expref: 22 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.273391:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8ea00/0xa13c582691d38228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38221 expref: 22 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.273399:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ea00, rc 0) 00000100:00100000:3.0:1788726083.273438:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558400:12345-0@lo:101:mount.lustre.0 Request processed in 98us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.273445:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788726083.273522:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726083.273545:0:19455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38228 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.273560:0:19455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38228 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788726083.274664:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788726083.275454:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788726083.280169:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788726083.280227:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788726083.280243:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788726083.280500:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788726083.280522:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788726083.280550:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788726083.280577:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788726083.280584:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788726083.280825:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726083.280891:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.281001:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726083.281362:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558528 00000100:00100000:3.0:1788726083.281370:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558528 00000100:00100000:3.0:1788726083.281478:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788726083.281489:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726083.281658:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558528:12345-0@lo:501:mount.lustre.0 Request processed in 170us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.281666:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788726083.281748:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726083.281783:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726083.281831:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726083.282591:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558656 00000100:00100000:0.0:1788726083.282599:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558656 00000100:00100000:2.0:1788726083.282615:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.282632:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788726083.282640:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726083.285674:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558656:12345-0@lo:503:mount.lustre.0 Request processed in 3026us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.285688:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788726083.285817:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558656:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788726083.286511:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788726083.286622:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726083.286677:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.286721:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a100300 going to sleep for 11 seconds 00000100:00100000:3.0:1788726083.286794:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558784 00000100:00100000:3.0:1788726083.286801:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558784 00000100:00100000:3.0:1788726083.286884:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788726083.286894:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726083.287494:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558784:12345-0@lo:502:mount.lustre.0 Request processed in 600us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.287509:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788726083.287591:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726083.287766:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788726083.287795:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788726083.287809:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788726083.287824:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788726083.287835:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788726083.287848:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788726083.287862:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788726083.287873:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788726083.287884:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788726083.287909:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726083.287948:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.288237:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a100300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726083.288414:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791558912 00000100:00100000:1.0:1788726083.288421:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791558912 00000100:00100000:1.0:1788726083.288454:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788726083.288463:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788726083.288595:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791558912:12345-0@lo:502:mount.lustre.0 Request processed in 133us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.288602:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788726083.288768:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791558912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726083.288820:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788726083.288831:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788726083.290411:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788726083.290422:0:19459:0:(obd_mount.c:972:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788726083.290429:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788726083.290432:0:19459:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788726083.290438:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788726083.290453:0:19459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b12826019b8) 00000020:00000080:2.0:1788726083.290477:0:19459:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788726083.290482:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788726083.290643:0:19459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283378800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788726083.290652:0:19459:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788726083.290661:0:19459:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa13c582691d38236 00010000:00010000:2.0:1788726083.294510:0:19459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788726083.296640:0:19459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788726083.300488:0:19459:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788726083.305697:0:19459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788726083.305714:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726083.305721:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726083.305723:0:19459:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788726083.305727:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726083.305731:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726083.305733:0:19459:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788726083.305736:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788726083.305738:0:19459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788726083.305741:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726083.305743:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726083.305744:0:19459:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788726083.305747:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788726083.305749:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726083.305750:0:19459:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788726083.305754:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788726083.305782:0:19459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788726083.305786:0:19459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788726083.305788:0:19459:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788726083.305791:0:19459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788726083.308205:0:19455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788726083.308256:0:19455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788726083.308279:0:19455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38228 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726083.308292:0:19455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6200/0xa13c582691d38221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38228 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726083.308301:0:19455:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1283378800 from 1 10000000:01000000:0.0:1788726083.308304:0:19455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726083.308340:0:19455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726083.308349:0:19455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726083.308367:0:19455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726083.308394:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788726083.308458:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726083.308499:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13a94b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726083.309462:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559040 00000100:00100000:1.0:1788726083.309472:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559040 00000100:00100000:1.0:1788726083.309519:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788726083.309527:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:19455:x1875614791559040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726083.309551:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726083.309566:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3823d expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.309593:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.309604:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.309626:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f400, rc 0) 00000100:00100000:1.0:1788726083.309679:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559040:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.309686:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788726083.309984:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788726083.310000:0:19455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726083.310009:0:19455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726083.313735:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788726083.314034:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788726083.314414:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788726083.314442:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788726083.314461:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788726083.314467:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788726083.314621:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726083.314698:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726083.314797:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128236d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788726083.316418:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559168 00000100:00100000:1.0:1788726083.316434:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559168 00000100:00100000:1.0:1788726083.316601:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788726083.316615:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788726083.316791:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559168:12345-0@lo:501:mount.lustre.0 Request processed in 179us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.316799:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788726083.316888:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788726083.316968:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726083.317023:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.326260:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.328696:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559296 00000100:00100000:0.0:1788726083.328710:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559296 00000100:00100000:0.0:1788726083.328762:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788726083.328772:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788726083.329005:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559296:12345-0@lo:503:mount.lustre.0 Request processed in 167us (11916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.329021:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788726083.329275:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788726083.329846:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788726083.329936:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726083.330229:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.330309:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.330491:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559424 00000100:00100000:0.0:1788726083.330497:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559424 00000100:00100000:0.0:1788726083.330590:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788726083.330599:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726083.330750:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559424:12345-0@lo:502:mount.lustre.0 Request processed in 151us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.330758:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788726083.331847:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726083.332470:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788726083.332580:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788726083.332599:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788726083.332613:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788726083.332640:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788726083.332655:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788726083.332668:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788726083.332680:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788726083.332693:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788726083.332705:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788726083.332718:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788726083.332761:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726083.332825:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.332901:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.333006:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559552 00000100:00100000:0.0:1788726083.333014:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559552 00000100:00100000:0.0:1788726083.333457:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788726083.333469:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726083.333783:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559552:12345-0@lo:502:mount.lustre.0 Request processed in 316us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.333791:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788726083.333879:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788726083.334013:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788726083.334027:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788726083.336086:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726083.336098:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336101:0:19463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788726083.336108:0:19463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1283378800 00000020:00000080:3.0:1788726083.336110:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788726083.336157:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726083.336161:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336162:0:19463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788726083.336164:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726083.336166:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336167:0:19463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788726083.336170:0:19463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b1283378800 00000020:00000080:3.0:1788726083.336172:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788726083.336224:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726083.336227:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336229:0:19463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788726083.336231:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726083.336234:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336235:0:19463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788726083.336237:0:19463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1283378800 00000020:00000080:3.0:1788726083.336239:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788726083.336254:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726083.336256:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336258:0:19463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788726083.336260:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788726083.336262:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336263:0:19463:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788726083.336266:0:19463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b1283378800 00000020:00000080:3.0:1788726083.336268:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788726083.336285:0:19463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788726083.336287:0:19463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788726083.336300:0:19463:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788726083.336303:0:19463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788726083.336776:0:19455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788726083.336806:0:19455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788726083.336828:0:19455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.336840:0:19455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726083.336891:0:19455:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788726083.336895:0:19455:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b1283378800 10000000:01000000:2.0:1788726083.336898:0:19455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b1283378800 10000000:01000000:2.0:1788726083.336901:0:19455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788726083.336907:0:19455:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9b1283378800 from 1 10000000:01000000:2.0:1788726083.336910:0:19455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788726083.336954:0:19455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.336962:0:19455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.336971:0:19455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.336995:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788726083.337055:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.337106:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726083.337153:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559680 00000100:00100000:1.0:1788726083.337160:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559680 00000100:00100000:1.0:1788726083.337201:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788726083.337211:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:19455:x1875614791559680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788726083.337224:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726083.337243:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949e000/0xa13c582691d38252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3824b expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.337265:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949e000/0xa13c582691d38252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3824b expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.337275:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949e000/0xa13c582691d38252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3824b expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.337283:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e000, rc 0) 00000100:00100000:1.0:1788726083.337334:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791559680:12345-0@lo:101:mount.lustre.0 Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.337339:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788726083.338527:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788726083.338611:0:19455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38252 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.338634:0:19455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38252 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788726083.344707:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788726083.344990:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788726083.345258:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788726083.345291:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788726083.345318:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788726083.345340:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788726083.345361:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788726083.345381:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788726083.345415:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788726083.345433:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788726083.345451:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788726083.345469:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788726083.345488:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788726083.345505:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788726083.345523:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788726083.345556:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788726083.345575:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788726083.345594:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788726083.345611:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788726083.345627:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788726083.345646:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788726083.345663:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788726083.345681:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788726083.345698:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788726083.345716:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788726083.345753:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788726083.345774:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788726083.345792:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788726083.345811:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788726083.345830:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788726083.345850:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788726083.345874:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788726083.345888:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788726083.345902:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788726083.345914:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788726083.345925:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788726083.345937:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788726083.345950:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788726083.345964:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788726083.345976:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788726083.345988:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788726083.346013:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788726083.346029:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788726083.346041:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788726083.346054:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788726083.346067:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788726083.346081:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788726083.346094:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788726083.346142:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788726083.346150:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788726083.346247:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726083.346313:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726083.346348:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559808 00000100:00100000:3.0:1788726083.346357:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.346416:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559808 00000100:00100000:0.0:1788726083.346470:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788726083.346481:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791559808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788726083.347818:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791559808:12345-0@lo:501:mount.lustre.0 Request processed in 1334us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.347829:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788726083.347875:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788726083.347914:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788726083.347963:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.348006:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788726083.348030:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791559936 00000100:00100000:2.0:1788726083.348036:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791559936 00000100:00100000:2.0:1788726083.348079:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788726083.348088:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791559936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726083.348210:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791559936:12345-0@lo:503:mount.lustre.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.348214:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791559936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788726083.348218:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000040:00080000:3.0:1788726083.349939:0:19455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788726083.350032:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726083.350114:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.350176:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.350698:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560064 00000100:00100000:0.0:1788726083.350707:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560064 00000100:00100000:0.0:1788726083.350755:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788726083.350765:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726083.350892:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560064:12345-0@lo:502:mount.lustre.0 Request processed in 127us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.350900:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788726083.351698:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726083.352012:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788726083.352058:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788726083.352917:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788726083.352932:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788726083.352944:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788726083.352958:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788726083.352971:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788726083.352984:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788726083.352996:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788726083.353009:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788726083.353024:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788726083.353038:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788726083.353051:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788726083.353484:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788726083.353509:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788726083.353522:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788726083.353549:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788726083.353581:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788726083.353598:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788726083.353611:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788726083.353625:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788726083.353638:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788726083.353651:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788726083.353664:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788726083.353679:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788726083.353693:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788726083.353707:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788726083.354510:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788726083.354563:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788726083.354583:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788726083.354605:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788726083.354621:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788726083.354635:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788726083.354662:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788726083.354678:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788726083.354693:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788726083.354711:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788726083.356056:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788726083.357565:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788726083.357592:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788726083.357613:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788726083.357631:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788726083.357649:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788726083.357669:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788726083.357690:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788726083.357707:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788726083.357739:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788726083.357756:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788726083.357832:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726083.357906:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.357956:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788726083.358037:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560192 00000100:00100000:0.0:1788726083.358044:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560192 00000100:00100000:0.0:1788726083.358104:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788726083.358144:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788726083.358265:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560192:12345-0@lo:502:mount.lustre.0 Request processed in 150us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.358273:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788726083.359867:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726083.360107:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788726083.360155:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788726083.360190:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788726083.360246:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.360290:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788726083.360309:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560320 00000100:00100000:2.0:1788726083.360316:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560320 00000100:00100000:2.0:1788726083.360363:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788726083.360373:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788726083.360477:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791560320:12345-0@lo:502:mount.lustre.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726083.360485:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788726083.362865:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791560320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788726083.362957:0:19455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788726083.362973:0:19455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788726083.364362:0:19468:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788726083.364380:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b13be5d8000) 00000020:00000080:3.0:1788726083.364477:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788726083.364577:0:19468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283378800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788726083.364581:0:19468:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1283378800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788726083.364584:0:19468:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1283378800 3 00010000:00080000:3.0:1788726083.364617:0:19468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b13bd4ab800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788726083.371871:0:19468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788726083.372169:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788726083.372216:0:19468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788726083.372229:0:19468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa13c582691d38260 00000100:00080000:3.0:1788726083.372240:0:19468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788726083.372247:0:19468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b13bd4ab800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726083.372282:0:19468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13be82b100 x1875614791560448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726083.372314:0:19468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788726083.372355:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791560448:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788726083.372365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726083.372370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726083.372374:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726083.372377:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788726083.372424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726083.372432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1788726083.372432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788726083.372437:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726083.372444:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1788726083.372457:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788726083.372463:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b139116b000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726083.372480:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13be82b800 x1875614791561088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788726083.372498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791560576:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.372544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.372568:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791561216:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.372597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.372690:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788726083.372698:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791560704:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.372724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.372743:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791561344:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.372766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.372790:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560448 00000100:00100000:1.0:1788726083.372796:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560448 00000100:00100000:1.0:1788726083.372816:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561216 00000100:00100000:1.0:1788726083.372819:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561216 00000100:00100000:1.0:1788726083.372837:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560704 00000100:00100000:1.0:1788726083.372840:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560704 00000100:00100000:1.0:1788726083.372850:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561344 00000100:00100000:1.0:1788726083.372853:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561344 00000100:00100000:1.0:1788726083.372954:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788726083.372964:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791561216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.373010:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791561216:12345-0@lo:400:kworker.0 Request processed in 48us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.373017:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788726083.373040:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788726083.373045:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791560704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.373073:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791560704:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.373078:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788726083.373089:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788726083.373095:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791561344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.373140:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791561344:12345-0@lo:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.373145:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788726083.373157:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726083.373161:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875614791560448:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788726083.373249:0:17134:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1788726083.373277:0:17134:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa13c582691d38267 00000004:00100000:1.0:1788726083.373291:0:17134:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788726083.373317:0:17134:0:(import.c:65:import_set_state_nolock()) ffff9b1282506000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726083.373349:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875614791560448:12345-0@lo:38:llog_process_th.0 Request processed in 185us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.373355:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726083.373375:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560576 00000100:00100000:1.0:1788726083.373378:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560576 00000100:00100000:1.0:1788726083.373402:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788726083.373409:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791560576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.373442:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791560576:12345-0@lo:400:kworker.0 Request processed in 33us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.373448:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788726083.373477:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726083.373493:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791561088:0@lo:8:kworker.0 00000100:00100000:1.0:1788726083.373550:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788726083.373582:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be82b100 x1875614791560448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726083.373592:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788726083.373599:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788726083.373605:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788726083.373609:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788726083.373739:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13bd4ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788726083.373746:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1875614791560448:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788726083.373779:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561088 00000100:00100000:1.0:1788726083.373783:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561088 00000100:00100000:1.0:1788726083.373804:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788726083.373808:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791561088:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788726083.373849:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791561088:12345-0@lo:8:kworker.0 Request processed in 38us (298us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788726083.373931:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788726083.373965:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be828a80 x1875614791560704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726083.373976:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791560704:0@lo:400:kworker.0 00010000:00080000:1.0:1788726083.373987:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be828000 x1875614791561344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726083.373996:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791561344:0@lo:400:kworker.0 00010000:00080000:1.0:1788726083.374005:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be82a680 x1875614791561216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726083.374022:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791561216:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.374035:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791560576:0@lo:400:kworker.0 00000100:00100000:1.0:1788726083.374064:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788726083.374068:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788726083.374072:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788726083.374075:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791561088:0@lo:8:kworker.0 00000100:00100000:3.0:1788726083.374735:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791560960:0@lo:400:kworker.0 00000100:00100000:3.0:1788726083.374781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.374814:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788726083.374821:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791560832:0@lo:400:kworker.0 00000100:00100000:3.0:1788726083.374864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.374906:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791561472:0@lo:400:kworker.0 00000100:00100000:3.0:1788726083.374928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.375109:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560960 00000100:00100000:2.0:1788726083.375128:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560960 00000100:00100000:2.0:1788726083.375179:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788726083.375189:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791560960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726083.375234:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791560960:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726083.375242:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788726083.375269:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788726083.375593:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be82aa00 x1875614791560960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726083.375605:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791560960:0@lo:400:kworker.0 00000100:00100000:3.0:1788726083.375631:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791560832 00000100:00100000:3.0:1788726083.375635:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791560832 00000100:00100000:3.0:1788726083.375664:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788726083.375670:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791560832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726083.375708:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791560832:12345-0@lo:400:kworker.0 Request processed in 38us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.375714:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788726083.375757:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791560832:0@lo:400:kworker.0 00000100:00100000:0.0:1788726083.376290:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561472 00000100:00100000:0.0:1788726083.376296:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561472 00000100:00100000:0.0:1788726083.376412:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726083.376421:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791561472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726083.376470:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791561472:12345-0@lo:400:kworker.0 Request processed in 51us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726083.376477:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788726083.377041:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b13be82b480 x1875614791561472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726083.377055:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791561472:0@lo:400:kworker.0 00000020:01000004:1.0:1788726083.377144:0:19468:0:(obd_mount.c:232:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788726083.377159:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9b1384b50000) 00000020:00000080:1.0:1788726083.377389:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788726083.377478:0:19468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b1283378800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788726083.377484:0:19468:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b1283378800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788726083.377487:0:19468:0:(obd_mount.c:721:lustre_put_lsi()) put ffff9b1283378800 3 00010000:00080000:1.0:1788726083.377515:0:19468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b128337f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788726083.380568:0:19468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788726083.380749:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788726083.380792:0:19468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788726083.380803:0:19468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa13c582691d38275 00000100:00080000:1.0:1788726083.380814:0:19468:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788726083.380819:0:19468:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9b128337f000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788726083.380852:0:19468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b1283758700 x1875614791561600/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788726083.381133:0:19468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788726083.381255:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791561600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788726083.381337:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.381556:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561600 00000100:00100000:1.0:1788726083.381564:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561600 00000100:00100000:1.0:1788726083.381603:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788726083.381617:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1875614791561600:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788726083.381642:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1788726083.381671:0:17135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa13c582691d3827c 00000004:00100000:1.0:1788726083.381686:0:17135:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788726083.381714:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b13bd4a9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726083.381767:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875614791561600:12345-0@lo:38:llog_process_th.0 Request processed in 150us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726083.381774:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788726083.381812:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b1283758700 x1875614791561600/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788726093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726083.381820:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788726083.381828:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788726083.381834:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788726083.381837:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788726083.381839:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b128337f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788726083.381844:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1875614791561600:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788726083.382985:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788726083.385877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726083.385887:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788726083.385890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788726083.385893:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788726083.386814:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788726083.388735:0:19455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788726083.388775:0:19455:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788726083.388792:0:19455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38252 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.388805:0:19455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13be9a6c00/0xa13c582691d3824b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38252 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788726083.388852:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788726083.389582:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788726083.389583:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726083.389585:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726083.389586:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726083.389588:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726083.389589:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788726083.389591:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726083.389592:0:19455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788726083.389596:0:19455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788726083.389599:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788726083.389601:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788726083.389603:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788726083.389604:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788726083.389605:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788726083.389606:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788726083.389607:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788726083.389608:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788726083.389608:0:19455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788726083.389635:0:19455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788726083.389657:0:19455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791561728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788726083.389727:0:19455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.389779:0:19455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788726083.390190:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561728 00000100:00100000:2.0:1788726083.390200:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561728 00000100:00100000:2.0:1788726083.390251:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788726083.390263:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791561728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788726083.390292:0:17126:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788726083.390305:0:17126:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788726083.397388:0:17126:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788726083.397403:0:17126:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788726083.397957:0:17149:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788726083.397964:0:17149:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788726083.397986:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.398005:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381f0 expref: 24 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.398013:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.398020:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.398079:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.398092:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726083.398107:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791561856:0@lo:104: 00000100:00100000:3.0:1788726083.400483:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:19455:x1875614791561728:12345-0@lo:253:mount.lustre.0 Request processed in 10212us (10745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.400498:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788726083.400696:0:19455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9d482790-b071-43b8-b9fc-f5e087ab8e22:19455:1875614791561728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788726083.400710:0:19455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788726083.400713:0:19455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788726083.400715:0:19455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788726083.400716:0:19455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788726083.400718:0:19455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788726083.400719:0:19455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788726083.400720:0:19455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788726083.400732:0:19455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788726083.400734:0:19455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788726083.400735:0:19455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788726083.400748:0:19455:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788726083.404229:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.404310:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561856 00000100:00100000:3.0:1788726083.404319:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561856 00000100:00100000:2.0:1788726083.404424:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726083.404438:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791561856:12345-0@lo:104: 00010000:00010000:2.0:1788726083.404454:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.404541:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726083.404547:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128375b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791561856:12345-0@lo:104: Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726083.404555:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788726083.404560:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726083.404568:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.404576:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ee00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788726083.404581:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.404590:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726083.404597:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726083.404602:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788726083.404640:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.404646:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788726083.404669:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.404676:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949ee00/0xa13c582691d381fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38205 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.404680:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791561984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788726083.404700:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726083.404703:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726083.404705:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726083.404719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726083.406285:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.406301:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726083.406325:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791562112:0@lo:104: 00000100:00100000:1.0:1788726083.406377:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726083.406419:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788726083.406426:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562112 00000100:00100000:3.0:1788726083.406434:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562112 00000100:00100000:1.0:1788726083.406441:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791561856:0@lo:104: 00000100:00100000:1.0:1788726083.406466:0:18290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791561984 00000100:00100000:1.0:1788726083.406471:0:18290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791561984 00000100:00100000:3.0:1788726083.406480:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788726083.406493:0:18290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726083.406521:0:18290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726083.406531:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791562112:12345-0@lo:104: 00000100:00100000:1.0:1788726083.406540:0:18290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3639:x1875614791561984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726083.406557:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.406557:0:18290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726083.406566:0:18290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.406589:0:18290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.406605:0:18290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d381fe expref: 24 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726083.406619:0:18290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726083.406621:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726083.406636:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:17149:x1875614791562112:12345-0@lo:104: Request processed in 145us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726083.406644:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788726083.406659:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17149:1875614791562112:0@lo:104: 00000100:00100000:1.0:1788726083.406663:0:18290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:3639:x1875614791561984:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1942us total) trans 0 rc 0/0 00010000:00010000:2.0:1788726083.406672:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788726083.406673:0:18290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788726083.406681:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.406687:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.406692:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8a00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726083.406699:0:17121:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.406709:0:17121:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726083.406716:0:17121:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726083.406723:0:17121:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788726083.406732:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791561984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726083.406759:0:17121:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.406766:0:17121:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788726083.406797:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.406804:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8a00/0xa13c582691d381f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381f7 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.406818:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726083.406820:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726083.406821:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726083.406855:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788726083.406866:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791562240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726083.406897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726083.407029:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562240 00000100:00100000:2.0:1788726083.407034:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562240 00010000:00010000:2.0:1788726083.407050:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.407080:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726083.407088:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:3641:x1875614791562240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788726083.407097:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726083.407102:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407112:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407158:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f000/0xa13c582691d381f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d381f0 expref: 23 pid: 17128 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407169:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407177:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788726083.407189:0:17120:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009226238s 00010000:00010000:2.0:1788726083.407193:0:17120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407200:0:17120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407207:0:17120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407220:0:17120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407225:0:17120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726083.407230:0:17120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407237:0:17120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407259:0:17120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726083.407270:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726083.407279:0:17149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.407288:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726083.407295:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f600/0xa13c582691d38283 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726083.407314:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3641:x1875614791562240:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726083.407321:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788726083.407382:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791562240:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788726083.415085:0:19455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788726083.418407:0:19455:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788726083.418415:0:19455:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788726083.418443:0:19455:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788726083.418478:0:19455:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788726083.418491:0:19455:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788726083.418506:0:19455:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788726083.419528:0:19455:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788726083.420035:0:19455:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788726083.515277:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726083.708693:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726083.708716:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791562368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788726083.708787:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726083.708900:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562368 00000100:00100000:3.0:1788726083.708907:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562368 00000100:00100000:3.0:1788726083.708959:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788726083.708969:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791562368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788726083.708998:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788726083.709053:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791562368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726083.709073:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788726083.709168:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82aa00 x1875614791562368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726083.709187:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791562368:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788726084.202878:0:19522:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788726084.203556:0:19522:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788726084.414577:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726063/real 1788726063] req@ffff9b12833bd880 x1875614791549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726083 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.414656:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b12833bd880 x1875614791549312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726083 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.414670:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788726063/real 1788726063] req@ffff9b12833bfb80 x1875614791549440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726083 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.414683:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b12833bfb80 x1875614791549440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788726083 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726084.414701:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726084.414726:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788726084.414730:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791549312:0@lo:8:kworker.0 00000100:00080000:0.0:1788726084.414736:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788726084.414742:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788726084.414754:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12833bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791549440:0@lo:8:kworker.0 00000100:00080000:3.0:1788726084.416777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726084.416784:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788726084.416787:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726084.416795:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1788726084.416800:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788726084.416807:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b13968fc800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726084.416827:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13be82b480 x1875614791562752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788726084.416840:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726084.416843:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788726084.416845:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726084.416848:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:3.0:1788726084.416851:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788726084.416854:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b1390daa000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726084.416866:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13be82b800 x1875614791562880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726084.416897:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791562752:0@lo:8:kworker.0 00000100:00080000:3.0:1788726084.416910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788726084.416914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788726084.416916:0:36:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788726084.416922:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9b139116b000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788726084.416935:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b13be828a80 x1875614791563392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788726084.416966:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.416994:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417011:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791562880:0@lo:8:kworker.0 00000100:00100000:3.0:1788726084.417045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.417051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417072:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791563264:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417086:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791563392:0@lo:8:kworker.0 00000100:00100000:3.0:1788726084.417100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.417139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417146:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791563904:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417174:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791563008:0@lo:400:kworker.0 00000100:00100000:3.0:1788726084.417182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.417211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417212:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788726084.417221:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791562624:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417234:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791563648:0@lo:400:kworker.0 00000100:00100000:3.0:1788726084.417252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.417266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417276:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791563520:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417291:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788726084.417299:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791563136:0@lo:400:kworker.0 00000100:00100000:3.0:1788726084.417305:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417323:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791564032:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.417365:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791563776:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.417397:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562752 00000100:00100000:3.0:1788726084.417406:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562752 00000100:00100000:0.0:1788726084.417416:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562880 00000100:00100000:0.0:1788726084.417422:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562880 00000100:00100000:3.0:1788726084.417431:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563264 00000100:00100000:3.0:1788726084.417436:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563264 00000100:00100000:0.0:1788726084.417441:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563392 00000100:00100000:0.0:1788726084.417446:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563392 00000100:00100000:0.0:1788726084.417464:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726084.417476:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.417537:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791563264:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.417872:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788726084.417878:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1875614791562752:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788726084.417903:0:18642:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1788726084.417934:0:18642:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d3828a 00002000:00100000:3.0:1788726084.417949:0:18642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b13881bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788726084.417953:0:18642:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788726084.417956:0:18642:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788726084.418026:0:18642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788726084.418045:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788726084.418077:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788726084.418082:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791562880:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788726084.418099:0:18640:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000100:00100000:2.0:1788726084.418176:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563904 00000100:00100000:2.0:1788726084.418181:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563904 00000020:00000080:0.0:1788726084.418212:0:18640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa13c582691d38291 00000100:00100000:2.0:1788726084.418216:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563008 00000100:00100000:2.0:1788726084.418221:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563008 00002000:00100000:0.0:1788726084.418222:0:18640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b12824ff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788726084.418228:0:18640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788726084.418230:0:18640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788726084.418235:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563648 00000100:00100000:2.0:1788726084.418239:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563648 00000100:00100000:2.0:1788726084.418256:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563520 00000100:00100000:2.0:1788726084.418259:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563520 00000100:00100000:2.0:1788726084.418276:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564032 00000100:00100000:2.0:1788726084.418279:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564032 00000100:00100000:2.0:1788726084.418299:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563776 00000100:00100000:2.0:1788726084.418302:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563776 00000100:00100000:2.0:1788726084.418322:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726084.418331:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791563904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726084.418384:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791563904:12345-0@lo:400:kworker.0 Request processed in 55us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418392:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788726084.418411:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788726084.418422:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791563008:12345-0@lo:400:kworker.0 00002000:00080000:0.0:1788726084.418452:0:18640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788726084.418460:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791563008:12345-0@lo:400:kworker.0 Request processed in 40us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418467:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788726084.418469:0:18640:0:(import.c:65:import_set_state_nolock()) ffff9b12824fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726084.418480:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788726084.418487:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791563648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.418520:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791562880:12345-0@lo:8:kworker.0 Request processed in 434us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418537:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791563648:12345-0@lo:400:kworker.0 Request processed in 37us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.418540:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726084.418549:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788726084.418565:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788726084.418570:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791563520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726084.418594:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791563520:12345-0@lo:400:kworker.0 Request processed in 24us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418600:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788726084.418622:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788726084.418628:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1875614791563392:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788726084.418645:0:18640:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1788726084.418662:0:18640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa13c582691d38298 00002000:00100000:0.0:1788726084.418669:0:18640:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9b12824f9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788726084.418672:0:18640:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788726084.418674:0:18640:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788726084.418697:0:18640:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788726084.418710:0:18640:0:(import.c:65:import_set_state_nolock()) ffff9b12824f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726084.418740:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1875614791563392:12345-0@lo:8:kworker.0 Request processed in 111us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418746:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788726084.418751:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726084.418757:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791564032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.418777:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562496 00000100:00100000:0.0:1788726084.418781:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562496 00000100:00100000:2.0:1788726084.418792:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791564032:12345-0@lo:400:kworker.0 Request processed in 38us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418799:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788726084.418814:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788726084.418823:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788726084.418824:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726084.418860:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791563776:12345-0@lo:400:kworker.0 Request processed in 40us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.418866:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788726084.418883:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788726084.418887:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788726084.418941:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3638:x1875614791562496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.418976:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3638:x1875614791562496:12345-0@lo:400:kworker.0 Request processed in 145us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.418982:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788726084.419025:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791562624 00000100:00100000:0.0:1788726084.419029:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791562624 00000100:00100000:0.0:1788726084.419142:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791563136 00000100:00100000:0.0:1788726084.419147:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791563136 00000100:00100000:0.0:1788726084.419163:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788726084.419169:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.419200:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791562624:12345-0@lo:400:kworker.0 Request processed in 31us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.419207:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788726084.419219:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788726084.419224:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.419251:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791563136:12345-0@lo:400:kworker.0 Request processed in 28us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.419257:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788726084.419291:0:18642:0:(import.c:65:import_set_state_nolock()) ffff9b13881ba000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726084.419299:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791563136:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419315:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283db4700 x1875614791563776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791563776:0@lo:400:kworker.0 00000100:00100000:3.0:1788726084.419332:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1875614791562752:12345-0@lo:8:kworker.0 Request processed in 1452us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.419346:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788726084.419419:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be829f80 x1875614791563008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419442:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791563008:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419458:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be829c00 x1875614791563648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791563648:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.419507:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791562624:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419520:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82b100 x1875614791563520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791563520:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419552:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283db7800 x1875614791564032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419610:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791564032:0@lo:400:kworker.0 00000100:00100000:0.0:1788726084.419621:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791562496:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419631:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be828000 x1875614791563264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419638:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791563264:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419652:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283db4000 x1875614791563904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791563904:0@lo:400:kworker.0 00010000:00080000:0.0:1788726084.419692:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be828a80 x1875614791563392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788726084.419716:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788726084.419723:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788726084.419728:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788726084.419731:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b139116b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788726084.419758:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788726084.419764:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1875614791563392:0@lo:8:kworker.0 00010000:00080000:0.0:1788726084.419781:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82b480 x1875614791562752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419788:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788726084.419793:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788726084.419798:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788726084.419800:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788726084.419803:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b13968fc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788726084.419822:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788726084.419826:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791562752:0@lo:8:kworker.0 00010000:00080000:0.0:1788726084.419986:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be82b800 x1875614791562880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788726109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.419994:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788726084.419999:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000004:00080000:1.0:1788726084.420003:0:17157:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1788726084.420004:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788726084.420009:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788726084.420011:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9b1390daa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788726084.420023:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788726084.420027:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1875614791562880:0@lo:8:kworker.0 00000004:00080000:0.0:1788726084.420077:0:17158:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788726084.420100:0:17158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17158:1875614791564288:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788726084.420151:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788726084.420159:0:17876:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788726084.420175:0:17158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e66c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788726084.420202:0:17160:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788726084.420215:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17160:1875614791564544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788726084.420225:0:17876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 529576106565ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788726084.420233:0:17876:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788726084.420241:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.420262:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e63c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788726084.420274:0:17159:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788726084.420314:0:17159:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529576196145ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788726084.420320:0:17159:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788726084.420337:0:17877:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788726084.420355:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791564800:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788726084.420383:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.420405:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726084.420420:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791564416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726084.420447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.420468:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788726084.420474:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791564160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726084.420499:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.420552:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564288 00000100:00100000:0.0:1788726084.420612:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564288 00000100:00100000:0.0:1788726084.420651:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564544 00000100:00100000:0.0:1788726084.420655:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564544 00000100:00100000:0.0:1788726084.420665:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564800 00000100:00100000:0.0:1788726084.420667:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564800 00000100:00100000:0.0:1788726084.420679:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726084.420685:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17158:x1875614791564288:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788726084.420834:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791564672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788726084.420862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.420903:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564416 00000100:00100000:3.0:1788726084.420908:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564416 00000100:00100000:3.0:1788726084.420923:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564160 00000100:00100000:3.0:1788726084.420926:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564160 00000100:00100000:3.0:1788726084.420934:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564672 00000100:00100000:3.0:1788726084.420936:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564672 00000100:00100000:3.0:1788726084.420947:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788726084.420953:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791564416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726084.420966:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00080000:0.0:1788726084.420998:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726084.421003:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726084.421087:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726084.421095:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:17160:x1875614791564544:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788726084.421280:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791564416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 324us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.421288:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788726084.421310:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726084.421318:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791564160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788726084.421330:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788726084.421358:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875614791564160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.421372:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788726084.421385:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788726084.421392:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875614791564672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788726084.421401:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788726084.421952:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875614791564672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 557us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.421958:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788726084.422173:0:17866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788726084.422625:0:17157:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 529578507299ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788726084.422636:0:17157:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788726084.423625:0:17113:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:0.0:1788726084.423763:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283db6d80 x1875614791564672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.423787:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791564672:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1788726084.425136:0:18640:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788726084.425145:0:18640:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788726084.425150:0:18640:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:3.0:1788726084.426787:0:17113:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788726084.426826:0:19181:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788726084.426834:0:19181:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788726084.426840:0:19181:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00010000:00080000:2.0:1788726084.427783:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b128259aa00 x1875614791564416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726084.427810:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791564416:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788726084.427849:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1282598000 x1875614791564160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788726100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726084.427861:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791564160:0@lo:13:osp-pre-0-0.0 00002000:00010000:0.0:1788726084.439911:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.439924:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.439941:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.439946:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.439951:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.439969:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.439979:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.439987:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.440012:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788726084.443225:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.443237:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443253:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.443264:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.443271:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443300:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443311:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443318:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443340:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788726084.443351:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726084.443358:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443365:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.443370:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443379:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443395:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443414:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786215ec/0xa13c582691d3829f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443436:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.443440:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443446:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.443450:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443457:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443468:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443475:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd12a7f8/0xa13c582691d382a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.443491:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.443493:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.443495:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.445919:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.445933:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.445956:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.445960:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.445966:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.445979:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.445990:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.445998:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446017:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726084.446030:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.446035:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446043:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.446047:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446067:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446094:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446101:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d9c5dc/0xa13c582691d382ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.446134:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.446136:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.446138:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.449991:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.450007:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.450027:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.450031:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.450039:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.450064:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.450075:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.450083:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.450137:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.450160:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.450169:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.450179:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a9200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.450185:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.450196:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.450224:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.450231:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b97c49/0xa13c582691d382b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.450257:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.450259:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.450261:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.452883:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.452895:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.452911:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.452916:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.452922:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.452936:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.452945:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.452952:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.452975:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.452996:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.453003:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.453013:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.453018:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.453028:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.453045:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.453053:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db0effa3/0xa13c582691d382bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.453092:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.453095:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.453097:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.454272:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.454283:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454295:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.454309:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.454315:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454328:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454336:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454343:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454363:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.454375:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.454515:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.454532:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.454536:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.454545:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.454559:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.454566:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000256c55f7/0xa13c582691d382c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.454584:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.454586:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.454588:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.454885:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.454892:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454901:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.454905:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.454909:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454918:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454926:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454941:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.454962:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.455169:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.455176:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.455195:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.455198:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.455206:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.455216:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.455223:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053f70ce9/0xa13c582691d382c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.455238:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.455239:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.455241:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.457348:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.457658:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.457668:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.457682:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.457685:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.457691:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.457704:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.457720:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.457727:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.457754:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726084.457820:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.457827:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457839:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.457843:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.457847:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457862:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457870:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457885:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457901:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788726084.457910:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788726084.457915:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457923:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.457927:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457936:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457953:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457960:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d382d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457977:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.457981:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.457997:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.458000:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458007:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458018:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458024:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d382d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458037:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.458039:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.458041:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.458262:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.458560:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.458567:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458577:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.458580:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.458584:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458594:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458618:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458693:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.458717:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726084.458830:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.458836:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.458844:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8fa00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.458848:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.458856:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.458870:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.458877:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005394f9e8/0xa13c582691d382de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.458894:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.458896:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.458898:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.459278:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.459285:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459295:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.459299:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.459304:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459314:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459322:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459330:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459397:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788726084.459765:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.459772:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459781:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.459784:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.459789:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459798:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459806:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.459814:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.459956:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726084.459962:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.459970:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.459974:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.459982:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.459994:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460001:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c295b2/0xa13c582691d382e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460016:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.460019:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460026:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.460028:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460035:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.460172:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.460180:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460188:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.460191:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.460195:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460206:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460213:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460223:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460248:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726084.460266:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460278:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.460282:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460288:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.460291:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460300:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460311:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460318:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8368e44/0xa13c582691d382f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.460334:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.460336:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.460338:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.460346:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.460552:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726084.460558:0:19181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d382ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.460620:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.460626:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460635:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.460638:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.460642:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460651:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460660:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.460666:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726084.460993:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.461000:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.461015:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.461018:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.461023:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.461033:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.461042:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.461049:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461151:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726084.461157:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.461158:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726084.461173:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.461177:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461186:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461200:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461208:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d382fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461225:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.461228:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461235:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.461239:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461246:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461255:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.461268:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.461270:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.461272:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.461279:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.461553:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726084.461559:0:19181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d38301 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.461909:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.461916:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.461925:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.461934:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.461939:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.461950:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.461963:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.461970:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726084.462019:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.462025:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462033:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.462037:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.462041:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462075:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462083:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462090:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462190:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726084.462197:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462205:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.462209:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462217:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462229:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462237:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.462241:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462248:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.462251:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462270:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462280:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.462288:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.462290:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.462292:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.462299:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.462473:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726084.462478:0:19181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d3830f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.462484:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788726084.462491:0:18640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5ba945f/0xa13c582691d38308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726084.462940:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.462947:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462956:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.462959:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.462964:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.462975:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.462979:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.462987:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463005:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.463005:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.463010:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.463019:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463020:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.463041:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.463059:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.463066:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463181:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.463187:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463195:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8ee00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.463199:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463207:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463220:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463229:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.463230:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.463238:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.463316:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788726084.463322:0:19181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d38316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726084.463624:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.463639:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463647:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.463650:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.463654:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463663:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463670:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.463687:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463815:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.463820:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463827:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.463831:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463839:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.463849:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.463883:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788726084.464445:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.464454:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.464461:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.464464:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.464468:0:19181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7dffc1e/0xa13c582691d38324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.464469:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.464478:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.464490:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.464498:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.464505:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.464538:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788726084.465566:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.465575:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.465586:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.465590:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.465594:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.465605:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.465612:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.465619:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.465628:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788726084.465998:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.466003:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.466011:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.466021:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.466025:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.466035:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.466043:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.466049:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.466056:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788726084.466213:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.466220:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.466230:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.466234:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.466245:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.466256:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.466265:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.466272:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.466281:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788726084.467026:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.467034:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467045:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.467048:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.467052:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467061:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467070:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467083:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467092:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788726084.467214:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.467221:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467231:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.467234:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.467239:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467249:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467257:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467277:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467285:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788726084.467796:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.467804:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467814:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.467817:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.467821:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467830:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467838:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467844:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.467851:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788726084.467978:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.467984:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.467993:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.467996:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.468000:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.468009:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.468016:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.468023:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.468031:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788726084.468523:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.468541:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.468556:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.468560:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.468565:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.468574:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.468583:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.468591:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.468599:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:0.0:1788726084.468777:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.468785:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1788726084.468791:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468800:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.468804:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468813:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468829:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468845:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d3831d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468868:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788726084.468872:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468879:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148bc00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.468883:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468892:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468903:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468911:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002456faeb/0xa13c582691d3832b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468925:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788726084.468928:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468934:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.468942:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468950:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468960:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468968:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be5cb84f/0xa13c582691d38332 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468983:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788726084.468986:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.468994:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.468997:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469004:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469013:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469019:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008190d1a7/0xa13c582691d38339 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469038:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788726084.469042:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469049:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fe00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469053:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469061:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469072:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469079:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b8c6893/0xa13c582691d38340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469091:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788726084.469094:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469100:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469104:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469137:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469164:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469173:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ed06e02/0xa13c582691d38347 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469186:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788726084.469189:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469195:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949fa00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469198:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469205:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469213:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469220:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024509bdd/0xa13c582691d3834e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469241:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788726084.469244:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469249:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469252:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469259:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469267:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469274:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1db222/0xa13c582691d38355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469284:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788726084.469287:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469293:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ae00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469296:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469315:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469325:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469332:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c2aada6/0xa13c582691d3835c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469345:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788726084.469348:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469354:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ec00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.469357:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469364:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.469374:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.469540:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.469548:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.469564:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.469568:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.469572:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.469584:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.469591:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.469598:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.469614:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.470249:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.470259:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470270:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.470274:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470283:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470298:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788726084.470305:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.470306:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f161a539/0xa13c582691d3836a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.470317:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.470328:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.470329:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.470332:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.470337:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470342:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.470346:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.470352:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470371:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.470374:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.470453:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.470474:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.470498:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.470504:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470512:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.470515:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470524:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470547:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470555:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d38371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.470569:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.470571:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.470573:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.470735:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d38363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.470760:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.470762:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.470764:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.471672:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.471681:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471692:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.471695:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.471705:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471716:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471736:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471744:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471764:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.471776:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.471781:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471788:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.471792:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471801:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471814:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471820:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d38378 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.471833:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.471840:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.471842:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.472272:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.472279:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472360:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.472363:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.472368:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472377:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472385:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472393:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472414:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.472558:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.472565:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.472574:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.472594:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.472602:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.472615:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.472622:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004128e737/0xa13c582691d3837f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.472637:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.472639:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.472640:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.472958:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.472965:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.472973:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.472977:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.472981:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473000:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473008:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473014:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473038:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.473077:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.473082:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.473089:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.473093:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.473100:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.473111:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.473140:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb716c2/0xa13c582691d38386 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.473155:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.473165:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.473167:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.473829:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.473836:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473845:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.473921:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.473926:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473937:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473945:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473962:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.473986:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.474012:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.474019:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474029:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.474033:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474042:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474056:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474063:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d3838d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474082:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.474084:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.474086:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788726084.474574:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.474584:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.474595:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.474599:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.474614:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.474697:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.474708:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.474716:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.474750:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.474863:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.474870:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474878:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ee00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.474882:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474889:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474901:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474919:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e501c0e2/0xa13c582691d38394 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.474938:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.474940:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.474941:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.476557:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.476570:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.476583:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.476587:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.476591:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.476712:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.476722:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.476728:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.476750:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.476862:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.476869:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.476878:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.476881:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.476903:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.476933:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.476940:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221613e7/0xa13c582691d3839b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.476959:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.476962:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.476963:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788726084.477089:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.477096:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477106:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.477110:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.477130:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477143:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477152:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477160:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477176:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788726084.477209:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.477216:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.477232:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.477236:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.477241:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477257:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.477262:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477271:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.477275:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477283:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477296:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477314:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd076e14/0xa13c582691d383a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.477329:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.477331:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.477333:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.477789:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.477798:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.477805:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.477823:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.477833:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.477838:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788726084.477839:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.477850:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477874:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.477886:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.477891:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477901:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477909:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477917:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.477929:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.478074:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.478079:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.478087:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.478091:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.478100:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.478112:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.478139:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e34383e/0xa13c582691d383b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.478153:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.478155:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.478156:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.478215:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.478220:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.478227:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.478248:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.478266:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c7460f3/0xa13c582691d383a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.478291:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.478293:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.478295:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788726084.479329:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788726084.479339:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.479351:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1788726084.479355:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726084.479360:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.479372:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788726084.479815:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.479822:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.479831:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.479834:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.479838:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.479849:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.479857:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.479864:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.479899:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.479981:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.479988:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.480009:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.480014:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.480022:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.480036:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.480044:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000826ec554/0xa13c582691d383be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.480061:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.480063:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.480065:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.481518:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.481551:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.481577:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.481662:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.481669:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.481677:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ec00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.481681:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.481703:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.481718:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.481725:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd356a2/0xa13c582691d383b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.481743:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.481745:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.481747:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.482995:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.483008:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483023:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.483027:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.483033:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483046:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483054:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483075:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483100:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.483173:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.483179:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483188:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ba00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.483192:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483201:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483216:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483237:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079cba191/0xa13c582691d383c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483257:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.483259:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.483261:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.483673:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.483681:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483691:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.483702:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.483707:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788726084.483712:0:18640:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.483720:0:18640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483730:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.483732:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483734:0:18640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.483744:0:18640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483748:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483763:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483764:0:18640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483785:0:18640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.483793:0:18640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.483794:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.483808:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788726084.483823:0:18640:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788726084.483865:0:18640:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788726084.483977:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17160:x1875614791564544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 62879us (63732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.483986:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788726084.484049:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17160:1875614791564544:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788726084.484071:0:17160:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788726084.484299:0:17160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17160:1875614791564928:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788726084.484337:0:17160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.484360:0:17160:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12837073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726084.484419:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791564928 00000100:00100000:3.0:1788726084.484426:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791564928 00000100:00100000:3.0:1788726084.484467:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788726084.484477:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791564800:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:3.0:1788726084.487081:0:18643:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788726084.487090:0:18643:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788726084.487190:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791564800:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2711us (66802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.487200:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788726084.487233:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788726084.487246:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17160:x1875614791564928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788726084.487297:0:18643:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788726084.487761:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283db4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791564800:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788726084.487775:0:17877:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788726084.487811:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791565056:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788726084.487864:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.487885:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1283707d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788726084.487908:0:18642:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788726084.487915:0:18642:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:2.0:1788726084.490504:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490521:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.490538:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490549:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490569:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490596:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d383cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490629:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.490634:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490642:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.490645:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490652:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490663:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490669:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7dffc1e/0xa13c582691d383d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.490682:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.490684:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.490686:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.490785:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726084.491263:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565056 00000100:00100000:3.0:1788726084.491274:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565056 00002000:00010000:3.0:1788726084.492205:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.492214:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.492229:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.492234:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.492240:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.492259:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.492268:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.492276:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.492297:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788726084.494053:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788726084.494061:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788726084.494064:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726084.494078:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791565056:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:0.0:1788726084.494080:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8ee00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726084.494086:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.494100:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.494133:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.494142:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065976222/0xa13c582691d383da lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.494159:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.494161:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726084.494162:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788726084.494260:0:19540:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788726084.494350:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791565056:12345-0@lo:5:osp-pre-1-1.0 Request processed in 279us (6485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.494358:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726084.494437:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791565056:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788726084.494450:0:17877:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788726084.494494:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791565184:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788726084.494537:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.494568:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.494614:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565184 00000100:00100000:2.0:1788726084.494622:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565184 00000100:00100000:2.0:1788726084.494822:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788726084.494831:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791565184:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788726084.494858:0:18642:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788726084.495753:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.495762:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.495777:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.495783:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.495789:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.495804:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.495814:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.495823:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.495850:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.496166:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.496174:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496183:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179c00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.496188:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496197:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496212:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496226:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3a1833/0xa13c582691d383e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496248:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.496257:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.496260:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788726084.496395:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788726084.496402:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.496412:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1788726084.496423:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726084.496428:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.496439:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.496447:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.496454:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726084.496475:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.496552:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.496558:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496566:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.496570:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496578:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496591:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496599:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001deea6e1/0xa13c582691d383e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.496625:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.496754:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.496756:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.497881:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.497891:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.497904:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.498667:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.498685:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498703:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498714:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498722:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498740:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.498752:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.498757:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498764:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.498769:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498779:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498794:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498814:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041e8947e/0xa13c582691d383ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.498833:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.498835:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.498838:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.499911:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.499920:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.499933:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.499937:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.499942:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.499954:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.499964:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.499972:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.499993:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726084.500079:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726084.500086:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.500111:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:2.0:1788726084.500135:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.500152:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.500166:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.500175:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb464ea5/0xa13c582691d383f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.500209:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.500211:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726084.500213:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.500898:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.500911:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.500922:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.500925:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.500930:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.500942:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.500951:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.500959:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.500989:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788726084.501018:0:19456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788726084.501061:0:19456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788726084.501067:0:19456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788726084.501353:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726084.501361:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.501368:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8e000 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788726084.501373:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.501381:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.501396:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.501403:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002833346/0xa13c582691d383fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.501419:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.501420:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.501422:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726084.501794:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17160:x1875614791564928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14548us (17452us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788726084.501803:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788726084.501999:0:17160:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788726084.502013:0:17160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17160:1875614791564928:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788726084.502026:0:17160:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:2.0:1788726084.502435:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.502444:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.502455:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.502459:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.502464:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.502489:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.502497:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.502506:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.502533:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.502662:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.502668:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.502677:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.502681:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.502690:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.502715:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.502912:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb716c2/0xa13c582691d38404 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.502931:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.502933:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.502935:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.503399:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.503408:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503417:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.503420:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.503425:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503433:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503439:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503452:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503466:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726084.503486:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726084.503491:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.503499:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788726084.503502:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.503509:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.503522:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.503541:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c7460f3/0xa13c582691d3840b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.503555:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.503557:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.503559:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788726084.503920:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788726084.503926:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503935:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1788726084.503938:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726084.503942:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503951:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503959:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503966:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.503987:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788726084.504089:0:18289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788726084.504095:0:18289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.504102:0:18289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788726084.504111:0:18289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.504482:0:18289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.504496:0:18289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.504504:0:18289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004128e737/0xa13c582691d38412 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.504517:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.504518:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726084.504520:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788726084.505224:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788726084.505232:0:19181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505243:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788726084.505247:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788726084.505252:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505263:0:19181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505272:0:19181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505280:0:19181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505314:0:19181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788726084.505324:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726084.505330:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505338:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f400 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726084.505343:0:17122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505352:0:17122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505366:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505374:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eda8f33f/0xa13c582691d38419 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.505401:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.505402:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726084.505404:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788726084.505462:0:19181:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788726084.505577:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17158:x1875614791564288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84888us (85422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726084.505586:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788726084.505716:0:17158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17158:1875614791564288:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788726084.505766:0:17158:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788726084.505855:0:17158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17158:1875614791565312:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788726084.505957:0:17158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726084.505984:0:17158:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7d4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.508786:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565312 00000100:00100000:2.0:1788726084.508800:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565312 00000100:00100000:2.0:1788726084.508867:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788726084.508893:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17158:x1875614791565312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788726084.508957:0:19540:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1788726084.516787:0:18637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788726084.516831:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788726084.517835:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17158:x1875614791565312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8940us (11872us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788726084.517845:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788726084.517957:0:17158:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788726084.517966:0:17158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17158:1875614791565312:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788726084.517982:0:17158:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1788726084.525028:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17877:x1875614791565184:12345-0@lo:5:osp-pre-1-1.0 Request processed in 30190us (30493us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788726084.525040:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726084.525081:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17877:1875614791565184:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788726084.525098:0:17877:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788726084.525169:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17877:1875614791565440:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788726084.525205:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.525238:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.525275:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565440 00000100:00100000:2.0:1788726084.525283:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565440 00000100:00100000:2.0:1788726084.525333:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788726084.525344:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17877:x1875614791565440:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788726084.525438:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17877:x1875614791565440:12345-0@lo:900:osp-pre-1-1.0 Request processed in 94us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.525445:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788726084.525493:0:17877:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13be828000 x1875614791565440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788726100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726084.525504:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17877:1875614791565440:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788726084.540944:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726084.731314:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791565568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726084.731405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.731475:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791565696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726084.731520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726084.731582:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565568 00000100:00100000:0.0:1788726084.731592:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565568 00000100:00100000:0.0:1788726084.731640:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565696 00000100:00100000:0.0:1788726084.731646:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565696 00000100:00100000:0.0:1788726084.731674:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788726084.731686:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791565568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788726084.731725:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726084.731787:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791565568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.731795:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788726084.731818:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788726084.731828:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791565696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788726084.731852:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788726084.731902:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791565696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726084.731910:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788726084.731975:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791565696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726084.732013:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791565568:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1788726084.859236:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788726084.859244:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b139e73e000 from 10 10000000:01000000:3.0:1788726084.859250:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788726084.859303:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.859317:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.859331:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726084.859365:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791565824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726084.859464:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.859534:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.859609:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565824 00000100:00100000:2.0:1788726084.859618:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565824 00000100:00100000:2.0:1788726084.859672:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788726084.859682:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791565824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726084.859694:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726084.859706:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148a000/0xa13c582691d38427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d38420 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.859729:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148a000/0xa13c582691d38427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d38420 expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.859739:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148a000/0xa13c582691d38427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38420 expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.859748:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a000, rc 0) 00000100:00100000:2.0:1788726084.859786:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791565824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.859800:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788726084.860001:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791565824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726084.860023:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38427 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.860034:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38427 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726084.860149:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791565952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788726084.860198:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.860220:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.860320:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791565952 00000100:00100000:2.0:1788726084.860328:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791565952 00000100:00100000:2.0:1788726084.860399:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788726084.860412:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791565952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788726084.860431:0:17128:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788726084.860454:0:17128:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788726084.860458:0:17128:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788726084.860585:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791565952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 174us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.860594:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788726084.860833:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791565952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788726084.860911:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788726084.860921:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38427 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.860941:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1384c8f400/0xa13c582691d38420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38427 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726084.860952:0:17131:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788726084.860954:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9b1283ea8000 from 10 10000000:01000000:3.0:1788726084.860957:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788726084.860982:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.861154:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.861165:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726084.861186:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791566080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726084.861229:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.861260:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.861551:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566080 00000100:00100000:2.0:1788726084.861559:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566080 00000100:00100000:2.0:1788726084.861612:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788726084.861621:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791566080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726084.861631:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726084.861641:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148bc00/0xa13c582691d38435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d3842e expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.861658:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148bc00/0xa13c582691d38435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d3842e expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.861667:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148bc00/0xa13c582691d38435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3842e expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726084.861675:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148bc00, rc 0) 00000100:00100000:2.0:1788726084.861706:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791566080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.861722:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788726084.861806:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791566080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726084.861819:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38435 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726084.861827:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38435 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726084.861868:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791566208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788726084.861897:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726084.862564:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138763a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788726084.866560:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566208 00000100:00100000:2.0:1788726084.866576:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566208 00000100:00100000:2.0:1788726084.866693:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788726084.866705:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791566208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788726084.866730:0:17126:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788726084.866750:0:17126:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788726084.866753:0:17126:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788726084.866884:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791566208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726084.866893:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788726084.867012:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791566208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788726084.867144:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788726084.867154:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38435 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726084.867166:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e200/0xa13c582691d3842e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38435 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726085.563490:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788726085.634020:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788726086.590388:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726087.612292:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788726088.635709:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726088.830829:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791566336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788726088.830894:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726088.830976:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566336 00000100:00100000:0.0:1788726088.830983:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566336 00000100:00100000:0.0:1788726088.831040:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788726088.831050:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791566336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788726088.831081:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726088.831140:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791566336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726088.831148:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788726088.831166:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726088.831198:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791566336:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788726089.125871:0:19812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788726089.660534:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726089.853940:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791566464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726089.854004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726089.854056:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726089.854062:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791566592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788726089.854088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726089.854142:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566464 00000100:00100000:0.0:1788726089.854149:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566464 00000100:00100000:0.0:1788726089.854188:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788726089.854196:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791566464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788726089.854234:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788726089.854276:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791566464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726089.854283:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788726089.854304:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566592 00000100:00100000:0.0:1788726089.854307:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566592 00000100:00100000:0.0:1788726089.854333:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726089.854340:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791566592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788726089.854357:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788726089.854394:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875614791566592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726089.854401:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788726089.854441:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791566592:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788726089.855180:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788726089.856967:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13be828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791566464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726089.857020:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791566720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726089.857069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726089.857131:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566720 00000100:00100000:0.0:1788726089.857138:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566720 00000100:00100000:0.0:1788726089.857174:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726089.857316:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791566720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788726089.857415:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726089.857458:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791566720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 275us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726089.857465:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788726089.857654:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791566720:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1788726089.859939:0:19456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788726089.860906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791566848:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.860967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.860999:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791567360:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861036:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791567872:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788726089.861077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791567232:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861107:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791567744:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861178:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791566976:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861249:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791567488:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861266:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861274:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791568000:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861298:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788726089.861303:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791567104:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.861320:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.861334:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791567616:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.863518:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726089.863575:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567360 00000100:00100000:1.0:1788726089.863583:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567360 00000100:00100000:1.0:1788726089.863639:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566976 00000100:00100000:1.0:1788726089.863643:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566976 00000100:00100000:1.0:1788726089.863669:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567104 00000100:00100000:1.0:1788726089.863672:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567104 00000100:00100000:1.0:1788726089.863688:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726089.863697:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791567360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.863753:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791567360:12345-0@lo:400:kworker.0 Request processed in 57us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.863760:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788726089.863775:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726089.863782:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791566976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.863817:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791566976:12345-0@lo:400:kworker.0 Request processed in 36us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.863823:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788726089.863842:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726089.863848:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791567104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.863878:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791567104:12345-0@lo:400:kworker.0 Request processed in 31us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.863883:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788726089.863900:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567872 00000100:00100000:1.0:1788726089.863903:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567872 00000100:00100000:1.0:1788726089.863925:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567232 00000100:00100000:1.0:1788726089.863928:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567232 00000100:00100000:1.0:1788726089.863939:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567744 00000100:00100000:1.0:1788726089.863941:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567744 00000100:00100000:1.0:1788726089.863953:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567488 00000100:00100000:1.0:1788726089.863955:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567488 00000100:00100000:1.0:1788726089.863965:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568000 00000100:00100000:1.0:1788726089.863968:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568000 00000100:00100000:1.0:1788726089.863979:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791567616 00000100:00100000:1.0:1788726089.863981:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791567616 00000100:00100000:1.0:1788726089.863992:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726089.863999:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791567872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864031:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791567872:12345-0@lo:400:kworker.0 Request processed in 33us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864037:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788726089.864047:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788726089.864052:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791567232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864075:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875614791567232:12345-0@lo:400:kworker.0 Request processed in 23us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864080:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788726089.864088:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788726089.864093:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791567744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864145:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875614791567744:12345-0@lo:400:kworker.0 Request processed in 51us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864151:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788726089.864164:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788726089.864170:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791567488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864198:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791567488:12345-0@lo:400:kworker.0 Request processed in 28us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864203:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788726089.864214:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788726089.864220:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791568000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864265:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791568000:12345-0@lo:400:kworker.0 Request processed in 45us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864271:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788726089.864284:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788726089.864290:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791567616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.864316:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791567616:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726089.864321:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788726089.864478:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791566848 00000100:00100000:3.0:1788726089.864482:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791566848 00000100:00100000:3.0:1788726089.864527:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788726089.864535:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3641:x1875614791566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726089.864572:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3641:x1875614791566848:12345-0@lo:400:kworker.0 Request processed in 38us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726089.864578:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788726089.864607:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788726089.864612:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726089.864614:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726089.864616:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726089.865505:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791568128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788726089.865546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726089.865584:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568128 00000100:00100000:3.0:1788726089.865589:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568128 00000100:00100000:3.0:1788726089.865616:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788726089.865624:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791568128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788726089.865645:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788726089.865676:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791568128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726089.865682:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788726089.865720:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b12836f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791568128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726089.867009:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791567104:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867027:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cadc00 x1875614791567616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867037:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791567616:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.867048:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791566976:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867073:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cad500 x1875614791567488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867081:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791567488:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867091:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cad880 x1875614791568000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867098:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791568000:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867200:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cae300 x1875614791567232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867209:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875614791567232:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867219:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cac700 x1875614791567744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867227:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1875614791567744:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.867238:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283758e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9d482790-b071-43b8-b9fc-f5e087ab8e22:3641:1875614791566848:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.867249:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791567360:0@lo:400:kworker.0 00010000:00080000:1.0:1788726089.867260:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b1283cad180 x1875614791567872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726089.867267:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791567872:0@lo:400:kworker.0 00000100:00100000:1.0:1788726089.867282:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726089.867289:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791568256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726089.867330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726089.867674:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568256 00000100:00100000:3.0:1788726089.867687:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568256 00000100:00100000:3.0:1788726089.867726:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788726089.867734:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791568256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726089.867753:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788726089.867792:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791568256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726089.867798:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788726089.868540:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791568256:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1788726089.996605:0:19865:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788726089.996872:0:19865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788726090.686377:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788726090.692741:0:19915:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788726090.692961:0:19915:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788726090.911111:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726090.911239:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514432 00000100:00100000:2.0:1788726090.911248:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514432 00000100:00100000:2.0:1788726090.911294:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:2.0:1788726090.911303:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1875614770514432:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788726090.911334:0:17126:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c589f1fa-df36-4201-a9a9-13f8f3801f25@192.168.203.12@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788726090.911373:0:17126:0:(genops.c:1385:class_connect()) connect: client c589f1fa-df36-4201-a9a9-13f8f3801f25, cookie 0xa13c582691d3843c 00000100:00080000:0.0:1788726090.911651:0:17126:0:(import.c:65:import_set_state_nolock()) ffff9b12824fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726090.911723:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+5:2394:x1875614770514432:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 419us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.911731:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 114 00000100:00100000:1.0:1788726090.919351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726090.919431:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514560 00000100:00100000:3.0:1788726090.919443:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514560 00000100:00100000:3.0:1788726090.919502:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:3.0:1788726090.919514:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+5:14892:x1875614770514560:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788726090.919529:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726090.919545:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8e600/0xa13c582691d38443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7184 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726090.919572:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8e600/0xa13c582691d38443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7184 expref: 6 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726090.919583:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8e600/0xa13c582691d38443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7184 expref: 6 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726090.919592:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8e600, rc 0) 00000100:00100000:3.0:1788726090.919652:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+6:14892:x1875614770514560:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.919660:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 115 00000100:00100000:1.0:1788726090.924827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726090.930327:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514688 00000100:00100000:3.0:1788726090.930421:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514688 00000100:00100000:3.0:1788726090.930610:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:3.0:1788726090.930621:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1391fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+6:14892:x1875614770514688:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788726090.930755:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1391fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+6:14892:x1875614770514688:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 136us (5936us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788726090.930764:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 116 00000100:00100000:2.0:1788726090.933270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726090.933375:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514816 00000100:00100000:0.0:1788726090.933384:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514816 00000100:00100000:0.0:1788726090.933505:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:0.0:1788726090.933517:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1391fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+6:14892:x1875614770514816:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788726090.933533:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726090.933550:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179800/0xa13c582691d3844a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a718b expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726090.933579:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179800/0xa13c582691d3844a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a718b expref: 7 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726090.933591:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179800/0xa13c582691d3844a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a718b expref: 7 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726090.933599:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179800, rc 0) 00000100:00100000:0.0:1788726090.933656:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1391fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+7:14892:x1875614770514816:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.933663:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 117 00000100:00100000:1.0:1788726090.936533:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726090.936677:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770514944 00000100:00100000:3.0:1788726090.936687:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770514944 00000100:00100000:3.0:1788726090.936734:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:3.0:1788726090.936744:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+7:14892:x1875614770514944:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788726090.936909:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14892:x1875614770514944:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 166us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.936917:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 118 00000100:00100000:1.0:1788726090.941561:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726090.941657:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515072 00000100:00100000:0.0:1788726090.941668:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515072 00000100:00100000:0.0:1788726090.941722:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1788726090.941733:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14892:x1875614770515072:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788726090.941883:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14892:x1875614770515072:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 151us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.941891:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:2.0:1788726090.950508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726090.950611:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515200 00000100:00100000:0.0:1788726090.950621:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515200 00000100:00100000:0.0:1788726090.950686:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:0.0:1788726090.950698:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515200:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726090.950872:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515200:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 168us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726090.950881:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 120 00000100:00100000:1.0:1788726090.974779:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726090.974899:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515328 00000100:00100000:3.0:1788726090.974909:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515328 00000100:00100000:3.0:1788726090.974961:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788726090.974971:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515328:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788726090.975470:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515328:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 498us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.975479:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:1.0:1788726090.985723:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726090.987241:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515456 00000100:00100000:3.0:1788726090.987255:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515456 00000100:00100000:3.0:1788726090.987318:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:3.0:1788726090.987327:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515456:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788726090.987465:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14911:x1875614770515456:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 138us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726090.987479:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 122 00000100:00100000:2.0:1788726090.999308:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726091.000991:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515584 00000100:00100000:1.0:1788726091.001004:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515584 00000100:00100000:1.0:1788726091.001255:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788726091.001266:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+8:14892:x1875614770515584:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726091.001284:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726091.001302:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a71bc expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.001330:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71bc expref: 9 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.001340:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949ec00/0xa13c582691d38451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71bc expref: 9 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.001349:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949ec00, rc 0) 00000100:00100000:1.0:1788726091.001411:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+9:14892:x1875614770515584:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 147us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.001418:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 123 00000100:00100000:1.0:1788726091.006935:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.007089:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515712 00000100:00100000:0.0:1788726091.007100:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515712 00000100:00100000:0.0:1788726091.007219:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:0.0:1788726091.007230:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+9:14892:x1875614770515712:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788726091.007253:0:17127:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788726091.007275:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788726091.007279:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788726091.007282:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788726091.007285:0:17127:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788726091.007287:0:17127:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788726091.017944:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+9:14892:x1875614770515712:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 10697us (10999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726091.017963:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 124 00000100:00100000:2.0:1788726091.026430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726091.026555:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515840 00000100:00100000:1.0:1788726091.026569:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515840 00000100:00100000:1.0:1788726091.026642:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788726091.026673:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+9:14892:x1875614770515840:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726091.026696:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726091.026719:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a71c3 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.026808:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.026822:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 10 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726091.026832:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f600, rc 0) 00000100:00100000:1.0:1788726091.026908:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e542050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14892:x1875614770515840:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 238us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.026916:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:1.0:1788726091.028897:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726091.028984:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770515968 00000100:00100000:3.0:1788726091.028996:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770515968 00000100:00100000:3.0:1788726091.029067:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:3.0:1788726091.029080:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14892:x1875614770515968:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788726091.029316:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14892:x1875614770515968:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 238us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726091.029324:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 126 00000100:00100000:0.0:1788726091.032088:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726091.032329:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516096 00000100:00100000:3.0:1788726091.032350:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516096 00000100:00100000:3.0:1788726091.032414:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1788726091.032425:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14892:x1875614770516096:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788726091.032624:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14892:x1875614770516096:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 199us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726091.032632:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:2.0:1788726091.035877:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726091.036216:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516224 00000100:00100000:1.0:1788726091.036230:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516224 00000100:00100000:1.0:1788726091.036307:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:1.0:1788726091.036319:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14913:x1875614770516224:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726091.036540:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14913:x1875614770516224:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 221us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.036549:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 128 00000100:00100000:1.0:1788726091.043606:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.044642:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516352 00000100:00100000:0.0:1788726091.044659:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516352 00000100:00100000:1.0:1788726091.044812:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:1.0:1788726091.044826:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14913:x1875614770516352:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726091.045113:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:14913:x1875614770516352:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 289us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.045157:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:0.0:1788726091.063199:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.063317:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726091.064073:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516480 00000100:00100000:2.0:1788726091.064087:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516480 00000100:00100000:2.0:1788726091.064162:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516736 00000100:00100000:2.0:1788726091.064165:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516736 00000100:00100000:2.0:1788726091.064181:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788726091.064207:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875614770516480:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788726091.064243:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7602ce63-3b47-483e-9534-de4ec2d7c695@192.168.203.12@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788726091.064457:0:17135:0:(genops.c:1385:class_connect()) connect: client 7602ce63-3b47-483e-9534-de4ec2d7c695, cookie 0xa13c582691d3845f 00000004:00100000:2.0:1788726091.064585:0:17135:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788726091.064855:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b1283540000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726091.065084:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2394:x1875614770516480:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 875us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.065093:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788726091.065154:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788726091.065160:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875614770516736:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788726091.065181:0:17135:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7602ce63-3b47-483e-9534-de4ec2d7c695@192.168.203.12@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788726091.065221:0:17135:0:(genops.c:1385:class_connect()) connect: client 7602ce63-3b47-483e-9534-de4ec2d7c695, cookie 0xa13c582691d38466 00000004:00100000:2.0:1788726091.065237:0:17135:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788726091.065768:0:17135:0:(import.c:65:import_set_state_nolock()) ffff9b13c1820800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788726091.065816:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2394:x1875614770516736:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 653us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.065824:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788726091.074232:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726091.074537:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516992 00000100:00100000:1.0:1788726091.074552:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516992 00000100:00100000:1.0:1788726091.074655:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788726091.074672:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770516992:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788726091.074739:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788726091.074865:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770516992:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 200us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.074874:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788726091.074905:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726091.081079:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726091.081325:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516864 00000100:00100000:2.0:1788726091.081338:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516864 00000100:00100000:2.0:1788726091.081432:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788726091.081444:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+6:0:x1875614770516864:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788726091.081511:0:17135:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788726091.081634:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+6:0:x1875614770516864:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 191us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.081642:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:1.0:1788726091.083579:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788726091.084938:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726091.085053:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770516608 00000100:00100000:1.0:1788726091.085065:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770516608 00000100:00100000:1.0:1788726091.085163:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788726091.085175:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:0:x1875614770516608:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788726091.085215:0:17133:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788726091.085411:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:0:x1875614770516608:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 237us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726091.085420:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:3.0:1788726091.088255:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.090797:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517120 00000100:00100000:0.0:1788726091.090820:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517120 00000100:00100000:0.0:1788726091.090907:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788726091.090919:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517120:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788726091.091056:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517120:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 139us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726091.091064:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788726091.093392:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726091.093428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726091.093456:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.093781:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517248 00000100:00100000:0.0:1788726091.093812:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517248 00000100:00100000:0.0:1788726091.093861:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517376 00000100:00100000:0.0:1788726091.093864:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517376 00000100:00100000:0.0:1788726091.093884:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788726091.093894:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770517248:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726091.093938:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7602ce63-3b47-483e-9534-de4ec2d7c695@192.168.203.12@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788726091.093978:0:19181:0:(genops.c:1385:class_connect()) connect: client 7602ce63-3b47-483e-9534-de4ec2d7c695, cookie 0xa13c582691d3846d 00002000:00100000:0.0:1788726091.093991:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7602ce63-3b47-483e-9534-de4ec2d7c695/ffff9b12824fa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726091.094004:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788726091.094251:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788726091.094286:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9b12824fd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726091.094368:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2394:x1875614770517248:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 474us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726091.094376:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788726091.094395:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788726091.094400:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770517376:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726091.094416:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7602ce63-3b47-483e-9534-de4ec2d7c695@192.168.203.12@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788726091.094432:0:19181:0:(genops.c:1385:class_connect()) connect: client 7602ce63-3b47-483e-9534-de4ec2d7c695, cookie 0xa13c582691d38474 00002000:00100000:0.0:1788726091.094437:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7602ce63-3b47-483e-9534-de4ec2d7c695/ffff9b13842bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726091.094443:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788726091.094812:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788726091.094834:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9b13842b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726091.094861:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2394:x1875614770517376:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 458us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726091.094868:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788726091.094979:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517504 00000100:00100000:2.0:1788726091.094985:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517504 00000100:00100000:2.0:1788726091.095038:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788726091.095049:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517504:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788726091.095087:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517504:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 41us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.095094:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788726091.100867:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726091.101113:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517632 00000100:00100000:0.0:1788726091.101234:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517632 00000100:00100000:1.0:1788726091.105203:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788726091.105225:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517632:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788726091.110661:0:17136:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5295us 00000004:00200000:2.0:1788726091.138229:0:17136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788726091.138443:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14892:x1875614770517632:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 33215us (37581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.138460:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000040:00080000:0.0:1788726091.197873:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788726091.315048:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726091.315204:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517760 00000100:00100000:2.0:1788726091.315218:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517760 00000100:00100000:2.0:1788726091.315297:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788726091.315309:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14936:x1875614770517760:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1788726091.315346:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726091.315380:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d3847b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a71f4 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315462:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315477:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315504:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726091.315575:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788726091.315579:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788726091.315622:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315654:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d3847b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71f4 expref: 8 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315675:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71f4 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726091.315685:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:2.0:1788726091.315688:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788726091.315693:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b000, rc 0) 00000100:00100000:2.0:1788726091.315773:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+7:14936:x1875614770517760:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 466us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726091.315781:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:1.0:1788726091.707715:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726092.733072:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726093.280069:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.280750:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770517888 00000100:00100000:2.0:1788726093.280764:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770517888 00000100:00100000:2.0:1788726093.280882:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788726093.280902:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:14988:x1875614770517888:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:2.0:1788726093.281102:0:17133:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726093.281369:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:14988:x1875614770517888:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 475us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.281378:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00080000:1.0:1788726093.281455:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788726093.285020:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726093.285481:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518016 00000100:00100000:1.0:1788726093.285495:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518016 00000100:00100000:1.0:1788726093.285650:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788726093.285663:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518016:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:1.0:1788726093.285730:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788726093.285856:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518016:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 194us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.285865:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:3.0:1788726093.289824:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788726093.292246:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.292417:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518144 00000100:00100000:0.0:1788726093.292432:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518144 00000100:00100000:0.0:1788726093.292591:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788726093.292604:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518144:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1788726093.292647:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726093.292776:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518144:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 174us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.292784:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:3.0:1788726093.293088:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726093.304257:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.307163:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518272 00000100:00100000:3.0:1788726093.307186:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518272 00000100:00100000:3.0:1788726093.307318:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00080000:1.0:1788726093.307489:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726093.308303:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518272:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1788726093.308486:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788726093.308692:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7602ce63-3b47-483e-9534-de4ec2d7c695+6:14988:x1875614770518272:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 402us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726093.314807:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788726093.529271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.535301:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518400 00000100:00100000:3.0:1788726093.535472:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518400 00000100:00100000:2.0:1788726093.535987:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:2.0:1788726093.536071:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+10:15019:x1875614770518400:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788726093.536093:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726093.536149:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148b800/0xa13c582691d38489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a71fb expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726093.536188:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148b800/0xa13c582691d38489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71fb expref: 11 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726093.536201:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148b800/0xa13c582691d38489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71fb expref: 11 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726093.536212:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b800, rc 0) 00000100:00100000:2.0:1788726093.536481:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770518400:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 415us (7222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.536490:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 130 00000100:00100000:0.0:1788726093.551947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.553192:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518528 00000100:00100000:3.0:1788726093.553210:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518528 00000100:00100000:3.0:1788726093.553355:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:3.0:1788726093.553369:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770518528:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788726093.554211:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770518528:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 837us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726093.554224:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788726093.569477:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.569716:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518656 00000100:00100000:2.0:1788726093.569731:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518656 00000100:00100000:2.0:1788726093.569819:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788726093.569832:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770518656:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788726093.570078:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770518656:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 248us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.570088:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 132 00000100:00100000:2.0:1788726093.575271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.575450:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518784 00000100:00100000:3.0:1788726093.575480:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518784 00000100:00100000:2.0:1788726093.576701:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:2.0:1788726093.576719:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770518784:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788726093.577188:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770518784:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 472us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.577198:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 133 00000100:00100000:0.0:1788726093.593776:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726093.595236:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770518912 00000100:00100000:1.0:1788726093.595257:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770518912 00000100:00100000:1.0:1788726093.595752:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:1.0:1788726093.595770:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770518912:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788726093.597971:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770518912:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 2188us (4192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.597989:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 134 00000100:00100000:0.0:1788726093.609786:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.610476:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519040 00000100:00100000:2.0:1788726093.610490:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519040 00000100:00100000:2.0:1788726093.610580:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788726093.610593:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770519040:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788726093.610816:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15027:x1875614770519040:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 225us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.610932:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 135 00000100:00100000:2.0:1788726093.613424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726093.613720:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519168 00000100:00100000:1.0:1788726093.613734:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519168 00000100:00100000:1.0:1788726093.613862:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:1.0:1788726093.613876:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:15019:x1875614770519168:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726093.613898:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726093.613921:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f000/0xa13c582691d38490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a722c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.613978:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f000/0xa13c582691d38490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a722c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.613991:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f000/0xa13c582691d38490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a722c expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.614158:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f000, rc 0) 00000100:00100000:1.0:1788726093.614233:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13920aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:15019:x1875614770519168:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 358us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.614241:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 136 00000100:00100000:3.0:1788726093.618312:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.618718:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519296 00000100:00100000:0.0:1788726093.618733:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519296 00000100:00100000:0.0:1788726093.618810:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:0.0:1788726093.618826:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:15019:x1875614770519296:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788726093.618861:0:17126:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788726093.618895:0:17126:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788726093.618899:0:17126:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788726093.618901:0:17126:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788726093.618904:0:17126:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788726093.618905:0:17126:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788726093.621312:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:15019:x1875614770519296:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 2476us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.621335:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 137 00000100:00100000:3.0:1788726093.628318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726093.629285:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519424 00000100:00100000:1.0:1788726093.629298:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519424 00000100:00100000:1.0:1788726093.629379:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:1.0:1788726093.629393:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:15019:x1875614770519424:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788726093.629417:0:17128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726093.629442:0:17128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7233 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.629488:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 13 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.629501:0:17128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 13 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726093.629512:0:17128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f800, rc 0) 00000100:00100000:1.0:1788726093.629601:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15019:x1875614770519424:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 210us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.629629:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 138 00000100:00100000:3.0:1788726093.631972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.632166:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519552 00000100:00100000:2.0:1788726093.632178:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519552 00000100:00100000:2.0:1788726093.632250:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:2.0:1788726093.632261:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15019:x1875614770519552:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788726093.632457:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15019:x1875614770519552:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 197us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.632474:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 139 00000100:00100000:0.0:1788726093.638475:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.638705:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519680 00000100:00100000:2.0:1788726093.638719:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519680 00000100:00100000:2.0:1788726093.639549:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:2.0:1788726093.639567:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15019:x1875614770519680:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788726093.639783:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15019:x1875614770519680:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 221us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.639792:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 140 00000100:00100000:3.0:1788726093.644428:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.646946:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519808 00000100:00100000:0.0:1788726093.646991:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519808 00000100:00100000:0.0:1788726093.647081:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:0.0:1788726093.647095:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15031:x1875614770519808:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726093.647413:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15031:x1875614770519808:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 223us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.647425:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 141 00000100:00100000:3.0:1788726093.653475:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.653668:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770519936 00000100:00100000:0.0:1788726093.653680:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770519936 00000100:00100000:0.0:1788726093.653746:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:0.0:1788726093.653757:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15031:x1875614770519936:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788726093.653939:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:15031:x1875614770519936:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 183us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.653947:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 142 00000100:00100000:2.0:1788726093.664667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726093.664742:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726093.664836:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520064 00000100:00100000:1.0:1788726093.664849:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520064 00000100:00100000:1.0:1788726093.664896:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520320 00000100:00100000:1.0:1788726093.664898:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520320 00000100:00100000:1.0:1788726093.664912:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788726093.664921:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875614770520064:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788726093.665379:0:17133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f6a07b65-b968-4d55-97e9-b26237de8f88@192.168.203.12@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:1.0:1788726093.665430:0:17133:0:(genops.c:1385:class_connect()) connect: client f6a07b65-b968-4d55-97e9-b26237de8f88, cookie 0xa13c582691d3849e 00000004:00100000:1.0:1788726093.665461:0:17133:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788726093.666086:0:17133:0:(import.c:65:import_set_state_nolock()) ffff9b13b4ffb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726093.666224:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2394:x1875614770520064:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 1301us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.666234:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788726093.666270:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788726093.666277:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2394:x1875614770520320:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788726093.666299:0:17133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f6a07b65-b968-4d55-97e9-b26237de8f88@192.168.203.12@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:1.0:1788726093.666341:0:17133:0:(genops.c:1385:class_connect()) connect: client f6a07b65-b968-4d55-97e9-b26237de8f88, cookie 0xa13c582691d384a5 00000004:00100000:1.0:1788726093.666360:0:17133:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788726093.666413:0:17133:0:(import.c:65:import_set_state_nolock()) ffff9b13b4fff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788726093.666439:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2394:x1875614770520320:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 161us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726093.666446:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788726093.675490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.675554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.675764:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520448 00000100:00100000:0.0:1788726093.675778:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520448 00000100:00100000:0.0:1788726093.675873:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520192 00000100:00100000:0.0:1788726093.675877:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520192 00000100:00100000:0.0:1788726093.675902:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788726093.675914:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:0:x1875614770520448:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788726093.675956:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788726093.676115:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:0:x1875614770520448:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 202us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.676160:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788726093.676181:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788726093.676189:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:0:x1875614770520192:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788726093.676224:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726093.676258:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:0:x1875614770520192:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 69us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.676264:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:1.0:1788726093.676652:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788726093.676658:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788726093.682194:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.682533:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520576 00000100:00100000:0.0:1788726093.682547:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520576 00000100:00100000:0.0:1788726093.682630:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788726093.682644:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770520576:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788726093.682690:0:17134:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788726093.682794:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770520576:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 151us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.682802:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788726093.694434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.694556:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520704 00000100:00100000:3.0:1788726093.694570:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520704 00000100:00100000:3.0:1788726093.694653:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788726093.694667:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770520704:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788726093.694797:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770520704:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726093.694806:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788726093.705977:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.706044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.706084:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.706325:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520832 00000100:00100000:0.0:1788726093.706349:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520832 00000100:00100000:0.0:1788726093.706404:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770520960 00000100:00100000:0.0:1788726093.706407:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770520960 00000100:00100000:0.0:1788726093.706437:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788726093.706447:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770520832:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726093.706503:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f6a07b65-b968-4d55-97e9-b26237de8f88@192.168.203.12@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1788726093.706554:0:19181:0:(genops.c:1385:class_connect()) connect: client f6a07b65-b968-4d55-97e9-b26237de8f88, cookie 0xa13c582691d384ac 00002000:00100000:0.0:1788726093.706570:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f6a07b65-b968-4d55-97e9-b26237de8f88/ffff9b13c1885000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726093.706585:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788726093.706688:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788726093.706724:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9b13c1886800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726093.706811:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2394:x1875614770520832:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 364us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.706839:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788726093.706861:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788726093.706867:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875614770520960:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788726093.706886:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f6a07b65-b968-4d55-97e9-b26237de8f88@192.168.203.12@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1788726093.706908:0:19181:0:(genops.c:1385:class_connect()) connect: client f6a07b65-b968-4d55-97e9-b26237de8f88, cookie 0xa13c582691d384b3 00002000:00100000:0.0:1788726093.706914:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f6a07b65-b968-4d55-97e9-b26237de8f88/ffff9b13c1882800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788726093.706922:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788726093.706968:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788726093.706985:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9b13c1887000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788726093.707019:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2394:x1875614770520960:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 150us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.707026:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788726093.707985:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521088 00000100:00100000:2.0:1788726093.708009:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521088 00000100:00100000:2.0:1788726093.708094:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788726093.708107:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12836f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770521088:12345-192.168.203.12@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788726093.708481:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12836f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770521088:12345-192.168.203.12@tcp:900:mount.lustre.0 Request processed in 375us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.708490:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788726093.712830:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726093.712941:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521216 00000100:00100000:0.0:1788726093.712955:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521216 00000100:00100000:0.0:1788726093.713048:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788726093.713061:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770521216:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788726093.713234:0:17137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788726093.713345:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15019:x1875614770521216:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 286us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726093.713353:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00010000:00010000:0.0:1788726093.760808:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788726093.929768:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726093.930155:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521344 00000100:00100000:3.0:1788726093.930166:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521344 00000100:00100000:3.0:1788726093.930233:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788726093.930244:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15054:x1875614770521344:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1788726093.930264:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726093.930287:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fc00/0xa13c582691d384ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7264 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930355:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930370:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930402:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726093.930453:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788726093.930458:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788726093.930493:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930521:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fc00/0xa13c582691d384ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 8 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930540:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726093.930549:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:3.0:1788726093.930552:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726093.930556:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8e800, rc 0) 00000100:00100000:3.0:1788726093.930640:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+7:15054:x1875614770521344:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 398us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726093.930648:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788726093.947391:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726093.947414:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791568384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788726093.947491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726093.947629:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568384 00000100:00100000:2.0:1788726093.947637:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568384 00000100:00100000:2.0:1788726093.947703:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726093.947712:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791568384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788726093.947733:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788726093.947783:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791568384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726093.947789:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726093.947833:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791568384:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788726093.948016:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788726094.779369:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726094.971813:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791568512:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.971929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972044:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791569024:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791569536:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972203:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791570048:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972263:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788726094.972272:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791568640:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972332:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791569152:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972373:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791569664:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972564:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791570176:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972617:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791568768:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972682:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791569280:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726094.972726:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568768 00000100:00100000:3.0:1788726094.972734:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791569792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726094.972742:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568768 00000100:00100000:3.0:1788726094.972770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.972800:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788726094.972807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791568896:0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.972839:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569280 00000100:00100000:3.0:1788726094.972840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726094.972845:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569280 00000100:00100000:3.0:1788726094.972875:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791569408:0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.972877:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568896 00000100:00100000:2.0:1788726094.972886:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568896 00000100:00100000:2.0:1788726094.972926:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788726094.972928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726094.972942:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791568768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.972949:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791569920:0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.973036:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791568768:12345-0@lo:400:kworker.0 Request processed in 97us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.973044:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788726094.973057:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569408 00000100:00100000:2.0:1788726094.973060:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569408 00000100:00100000:2.0:1788726094.973089:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726094.973095:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791569280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.973144:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791569280:12345-0@lo:400:kworker.0 Request processed in 49us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.973150:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788726094.973160:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726094.973165:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.973205:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791568896:12345-0@lo:400:kworker.0 Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.973210:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788726094.973220:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788726094.973225:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.973245:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791569408:12345-0@lo:400:kworker.0 Request processed in 20us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.973250:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788726094.973588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726094.973648:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791568768:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.973666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791569280:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.973697:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791568896:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.973707:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788726094.973721:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791569408:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.973768:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568512 00000100:00100000:3.0:1788726094.973775:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568512 00000100:00100000:3.0:1788726094.973831:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788726094.973842:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3638:x1875614791568512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.973913:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3638:x1875614791568512:12345-0@lo:400:kworker.0 Request processed in 72us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726094.973920:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788726094.973960:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569024 00000100:00100000:3.0:1788726094.973965:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569024 00000100:00100000:0.0:1788726094.974297:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569536 00000100:00100000:0.0:1788726094.974305:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569536 00000100:00100000:0.0:1788726094.974335:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570048 00000100:00100000:0.0:1788726094.974346:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570048 00000100:00100000:0.0:1788726094.974380:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569664 00000100:00100000:0.0:1788726094.974384:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569664 00000100:00100000:0.0:1788726094.974397:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570176 00000100:00100000:0.0:1788726094.974400:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570176 00000100:00100000:0.0:1788726094.974413:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569920 00000100:00100000:0.0:1788726094.974416:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569920 00000100:00100000:0.0:1788726094.974434:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726094.974442:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791569024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.974517:0:17135:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788726094.974518:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875614791569024:12345-0@lo:400:kworker.0 Request processed in 76us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726094.974535:0:17135:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788726094.974536:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788726094.974565:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788726094.974577:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788726094.974578:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791569536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.974597:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791570048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726094.974621:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791569536:12345-0@lo:400:kworker.0 Request processed in 47us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726094.974630:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788726094.974647:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788726094.974658:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788726094.974664:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875614791570048:12345-0@lo:400:kworker.0 Request processed in 71us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726094.974675:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.974685:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788726094.974725:0:17133:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788726094.974733:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875614791569664:12345-0@lo:400:kworker.0 Request processed in 62us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726094.974740:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788726094.974751:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791570176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.974803:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791570176:12345-0@lo:400:kworker.0 Request processed in 54us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726094.974882:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788726094.974900:0:17134:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788726094.974907:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788726094.974915:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791569920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726094.974953:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791569920:12345-0@lo:400:kworker.0 Request processed in 40us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726094.974974:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788726094.975257:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569792 00000100:00100000:3.0:1788726094.975264:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569792 00000100:00100000:3.0:1788726094.975536:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788726094.975547:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791569792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788726094.975579:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788726094.975637:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875614791569792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726094.975644:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788726094.975669:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788726094.975676:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788726094.975680:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726094.975684:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726094.975865:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1875614791569664:0@lo:400:kworker.0 00010000:00080000:3.0:1788726094.975888:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af860e00 x1875614791570176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788726094.975902:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791570176:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.975926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9d482790-b071-43b8-b9fc-f5e087ab8e22:3638:1875614791568512:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.975950:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875614791569024:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.975966:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791569536:0@lo:400:kworker.0 00000100:00100000:3.0:1788726094.976072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1875614791570048:0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.978247:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791568640 00000100:00100000:2.0:1788726094.978277:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791568640 00000100:00100000:2.0:1788726094.978336:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791569152 00000100:00100000:2.0:1788726094.978339:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791569152 00000100:00100000:2.0:1788726094.978429:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788726094.978439:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791568640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.978557:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791568640:12345-0@lo:400:kworker.0 Request processed in 116us (6243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.978568:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788726094.978608:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788726094.978618:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.978666:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791569152:12345-0@lo:400:kworker.0 Request processed in 50us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.978674:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788726094.978753:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791568640:0@lo:400:kworker.0 00000100:00100000:2.0:1788726094.978775:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791569152:0@lo:400:kworker.0 00000100:00100000:1.0:1788726094.979254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791570688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788726094.979294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726094.979319:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788726094.979324:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791570560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788726094.979345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726094.979489:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570688 00000100:00100000:2.0:1788726094.979495:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570688 00000100:00100000:2.0:1788726094.979556:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570560 00000100:00100000:2.0:1788726094.979560:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570560 00000100:00100000:0.0:1788726094.981401:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788726094.981539:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791570432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788726094.981633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726094.981838:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726094.981846:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726094.981988:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726094.982202:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570432 00000100:00100000:0.0:1788726094.982213:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570432 00000100:00100000:0.0:1788726094.982251:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570304 00000100:00100000:0.0:1788726094.982254:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570304 00000100:00100000:0.0:1788726094.982270:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726094.982288:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791570432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788726094.982312:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788726094.982359:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791570432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726094.982366:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726094.982379:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726094.982385:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791570304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726094.982403:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726094.982429:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791570304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726094.982434:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726094.982495:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726094.982511:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791570432:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788726094.982550:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af862680 x1875614791569920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726094.982570:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791569920:0@lo:400:kworker.0 00000100:00100000:0.0:1788726094.982605:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1875614791569792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788726094.983301:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788726094.983316:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791570688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788726094.983342:0:17138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788726094.983473:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788726094.983484:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791570560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788726094.983503:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788726094.983566:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791570560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726094.983572:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788726094.983726:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791570688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 415us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726094.983732:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788726094.984244:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791570560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726094.984257:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791570688:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788726095.804337:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788726095.868867:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788726096.829693:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788726096.855185:0:20013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788726097.027531:0:17866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f6a07b65-b968-4d55-97e9-b26237de8f88 00000001:00100000:0.0:1788726097.027550:0:17866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7602ce63-3b47-483e-9534-de4ec2d7c695 00000001:00100000:0.0:1788726097.027580:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f6a07b65-b968-4d55-97e9-b26237de8f88 00000001:00100000:0.0:1788726097.027586:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7602ce63-3b47-483e-9534-de4ec2d7c695 00000001:00100000:3.0:1788726097.028823:0:19456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f6a07b65-b968-4d55-97e9-b26237de8f88 00000001:00100000:3.0:1788726097.029829:0:19456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7602ce63-3b47-483e-9534-de4ec2d7c695 00000001:00100000:3.0:1788726097.031654:0:17113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f6a07b65-b968-4d55-97e9-b26237de8f88 00000001:00100000:3.0:1788726097.031669:0:17113:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7602ce63-3b47-483e-9534-de4ec2d7c695 00010000:00010000:0.0:1788726097.852389:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726098.875313:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726099.071318:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791570816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788726099.071385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726099.071564:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791570816 00000100:00100000:0.0:1788726099.071572:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791570816 00000100:00100000:0.0:1788726099.071645:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788726099.071655:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791570816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788726099.071683:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726099.071728:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791570816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.071736:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788726099.071811:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128346f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791570816:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788726099.071949:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726099.138722:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138768:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138793:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138869:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138922:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726099.138947:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521856 00000100:00100000:0.0:1788726099.138956:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521856 00000100:00100000:0.0:1788726099.139009:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522368 00000100:00100000:0.0:1788726099.139012:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522368 00000100:00100000:0.0:1788726099.139025:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521984 00000100:00100000:0.0:1788726099.139027:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521984 00000100:00100000:0.0:1788726099.139039:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522496 00000100:00100000:0.0:1788726099.139041:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522496 00000100:00100000:0.0:1788726099.139056:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788726099.139065:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139161:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139168:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788726099.139185:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788726099.139191:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139216:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139221:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788726099.139231:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788726099.139237:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139259:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139273:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788726099.139285:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788726099.139291:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139314:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139320:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788726099.139341:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521472 00000100:00100000:0.0:1788726099.139344:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521472 00000100:00100000:0.0:1788726099.139370:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:0.0:1788726099.139377:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2396:x1875614770521472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139401:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2396:x1875614770521472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139407:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 144 00000100:00100000:0.0:1788726099.139447:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521600 00000100:00100000:0.0:1788726099.139451:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521600 00000100:00100000:0.0:1788726099.139469:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522112 00000100:00100000:0.0:1788726099.139472:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522112 00000100:00100000:0.0:1788726099.139484:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770521728 00000100:00100000:0.0:1788726099.139486:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770521728 00000100:00100000:0.0:1788726099.139496:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522240 00000100:00100000:0.0:1788726099.139498:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522240 00000100:00100000:0.0:1788726099.139511:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788726099.139517:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2396:x1875614770521600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788726099.139544:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128346f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2396:x1875614770521600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 28us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139550:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788726099.139570:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788726099.139576:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2396:x1875614770522112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726099.139784:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788726099.139793:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726099.139822:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770521728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726099.139828:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788726099.139842:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:1.0:1788726099.139849:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726099.139873:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770522240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726099.139890:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:0.0:1788726099.139947:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2396:x1875614770522112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 370us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726099.139954:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00080000:0.0:1788726099.139974:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788726099.139977:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788726099.139980:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726099.139982:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788726099.899343:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788726100.075343:0:20161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff70ae0f00 20000000:00000080:3.0:1788726100.075358:0:20161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b13c1862000 uarg=0000000000000000 20000000:01000000:3.0:1788726100.075398:0:20161:0:(mgs_llog.c:6195:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788726100.075403:0:20161:0:(mgs_llog.c:4650:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788726100.075408:0:20161:0:(mgs_llog.c:1382:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788726100.077853:0:20162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788726100.077932:0:20161:0:(mgs_llog.c:1453:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788726100.089173:0:20161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788726100.089236:0:20161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089255:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38156 expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089262:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089269:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d381a3 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089275:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089284:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089290:0:20161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089296:0:20161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089339:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089354:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 12 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.089389:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791570944:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726100.089512:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089521:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.089529:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571072:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726100.089559:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089568:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.089654:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571200:0@lo:104: 00000100:00100000:1.0:1788726100.089694:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726100.089778:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.089787:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 23 pid: 17127 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.089795:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571328:0@lo:104: 00000100:00100000:1.0:1788726100.089817:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788726100.091302:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091313:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791571456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788726100.091320:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.091343:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791572096:0@lo:104: 00000100:00100000:0.0:1788726100.091359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726100.091380:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.091385:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791571968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726100.091411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726100.091436:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571200 00000100:00100000:3.0:1788726100.091444:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571200 00000100:00100000:0.0:1788726100.091447:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788726100.091455:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788726100.091478:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571328 00000100:00100000:0.0:1788726100.091481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726100.091483:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571328 00000100:00100000:3.0:1788726100.091503:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788726100.091513:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:20161:x1875614791571200:12345-0@lo:104: 00000100:00100000:0.0:1788726100.091516:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791571584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788726100.091526:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.091568:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788726100.091575:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791571712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788726100.091599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.091622:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571456 00000100:00100000:0.0:1788726100.091626:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571456 00000100:00100000:0.0:1788726100.091649:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571584 00000100:00100000:0.0:1788726100.091657:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571584 00000100:00100000:0.0:1788726100.091673:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788726100.091679:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791571456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788726100.091707:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00010000:00010000:3.0:1788726100.091720:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788726100.091728:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:20161:x1875614791571200:12345-0@lo:104: Request processed in 217us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726100.091736:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726100.091751:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791571456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726100.091758:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726100.091762:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788726100.091768:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:20161:x1875614791571328:12345-0@lo:104: 00000100:00100000:0.0:1788726100.091780:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788726100.091782:0:17117:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091790:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791571584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788726100.091809:0:17892:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00010000:00010000:3.0:1788726100.091827:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788726100.091834:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:20161:x1875614791571328:12345-0@lo:104: Request processed in 68us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726100.091841:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726100.091850:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791571584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.091856:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1788726100.091862:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788726100.091869:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726100.091878:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13af8a8e00 already unused, calling callback (ffffffffc1262c20) 00000100:00100000:0.0:1788726100.091880:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571968 10000000:00010000:3.0:1788726100.091884:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091885:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571968 00010000:00010000:3.0:1788726100.091895:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726100.091903:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726100.091909:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788726100.091925:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571840 00000100:00100000:0.0:1788726100.091929:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571840 00010000:00010000:3.0:1788726100.091941:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091944:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791571712 00000100:00100000:0.0:1788726100.091948:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791571712 00010000:00010000:3.0:1788726100.091953:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788726100.091967:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091968:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788726100.091978:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13af8a8e00/0xa13c582691d3823d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d38244 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.091978:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791571968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726100.091992:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00010000:00010000:3.0:1788726100.091996:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788726100.092000:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726100.092006:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ea00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:3.0:1788726100.092009:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726100.092016:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788726100.092023:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788726100.092029:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788726100.092040:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af866680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791571968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.092047:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788726100.092062:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.092063:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788726100.092072:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788726100.092073:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791571840:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788726100.092082:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726100.092092:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949ea00/0xa13c582691d381a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d381aa expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726100.092102:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726100.092104:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726100.092105:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1788726100.092114:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788726100.092166:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875614791571840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.092172:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788726100.092184:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788726100.092189:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791571712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788726100.092198:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788726100.092221:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875614791571712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.092227:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788726100.092251:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788726100.092258:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788726100.092262:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788726100.092271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791572352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.092299:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.092325:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788726100.092330:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791572224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.092351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.092375:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572352 00000100:00100000:0.0:1788726100.092379:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572352 00010000:00010000:0.0:1788726100.092396:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 24 pid: 17127 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.092415:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572224 00000100:00100000:0.0:1788726100.092418:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572224 00010000:00010000:0.0:1788726100.092440:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 25 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.092470:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726100.092477:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+25:3639:x1875614791572352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726100.092487:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.092492:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 25 pid: 17127 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.092501:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 25 pid: 17127 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.092516:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726100.092543:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+25:3639:x1875614791572352:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.092549:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788726100.092560:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726100.092566:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3639:x1875614791572224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726100.092572:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.092576:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 24 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.092583:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 24 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.092591:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726100.092613:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3639:x1875614791572224:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.092618:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788726100.092664:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1875614791571712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788726100.092688:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791571584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788726100.092715:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791572224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.092722:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791572352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.092750:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791571840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788726100.092762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791571456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788726100.092773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1875614791571968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788726100.093215:0:20161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 23 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.093226:0:20161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 23 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.093237:0:20161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791572480:0@lo:104: 00000100:00100000:1.0:1788726100.093264:0:20161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726100.093278:0:20161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1386481f00 going to sleep for 11 seconds 00010000:00010000:1.0:1788726100.093291:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f400/0xa13c582691d38244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d3823d expref: 23 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.093303:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d95c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571200:0@lo:104: 00010000:00010000:1.0:1788726100.093313:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13be9a7e00/0xa13c582691d381aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d381a3 expref: 22 pid: 17127 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.093320:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571328:0@lo:104: 00000100:00100000:2.0:1788726100.093480:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572096 00000100:00100000:2.0:1788726100.093486:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572096 00000100:00100000:2.0:1788726100.093510:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572480 00000100:00100000:2.0:1788726100.093514:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572480 00000100:00100000:2.0:1788726100.093528:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726100.093537:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:20161:x1875614791572096:12345-0@lo:104: 00010000:00010000:2.0:1788726100.093547:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093681:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788726100.093689:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+4:20161:x1875614791572096:12345-0@lo:104: Request processed in 153us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726100.093696:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788726100.093712:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788726100.093719:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:20161:x1875614791572480:12345-0@lo:104: 00010000:00010000:2.0:1788726100.093727:0:17116:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093757:0:17116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788726100.093762:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+3:20161:x1875614791572480:12345-0@lo:104: Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726100.093767:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788726100.093779:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788726100.093783:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093790:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8ec00 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726100.093793:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093813:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726100.093820:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726100.093825:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788726100.093847:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093854:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788726100.093866:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093872:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b1384c8ec00/0xa13c582691d38164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3816b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093882:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726100.093886:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093891:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e200 already unused, calling callback (ffffffffc1262c20) 10000000:00010000:2.0:1788726100.093894:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093900:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788726100.093905:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788726100.093915:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788726100.093929:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093935:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788726100.093941:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093948:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9b13a949e200/0xa13c582691d38156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa13c582691d3815d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.093960:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726100.093962:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726100.093963:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726100.094166:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726100.094233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726100.094247:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791570944:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788726100.094261:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791571072:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788726100.094272:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791572096:0@lo:104: 00000100:00100000:0.0:1788726100.094279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726100.094285:0:20161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283d96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20161:1875614791572480:0@lo:104: 00000100:00100000:0.0:1788726100.094309:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791572608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788726100.094314:0:20161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.094344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.094380:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788726100.094386:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791572736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.094403:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.094441:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522624 00000100:00100000:0.0:1788726100.094445:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522624 00010000:00010000:0.0:1788726100.094466:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 13 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.094480:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522752 00000100:00100000:0.0:1788726100.094483:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522752 00010000:00010000:0.0:1788726100.094492:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 14 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.094501:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572608 00000100:00100000:0.0:1788726100.094510:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572608 00010000:00010000:0.0:1788726100.094525:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 22 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.094535:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572736 00000100:00100000:0.0:1788726100.094538:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572736 00010000:00010000:0.0:1788726100.094548:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 23 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.094560:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788726100.094566:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c589f1fa-df36-4201-a9a9-13f8f3801f25+14:2395:x1875614770522624:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726100.094577:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.094581:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 14 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.094591:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 14 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.094604:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f800/0xa13c582691d38497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7233 expref: 14 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.094615:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726100.094649:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2395:x1875614770522624:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 82us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.094656:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788726100.094675:0:18290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:0.0:1788726100.095284:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726100.095296:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13881e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:3640:x1875614791572608:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726100.095297:0:17119:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:0.0:1788726100.095307:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.095313:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726100.095315:0:17119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788726100.095332:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.095344:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f200/0xa13c582691d3816b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d38164 expref: 23 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.095354:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726100.095404:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13881e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:3640:x1875614791572608:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.095413:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788726100.095442:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788726100.095452:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:3640:x1875614791572736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788726100.095462:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.095467:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 21 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726100.095477:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 21 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726100.095487:0:18290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:2396:x1875614770522752:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726100.095491:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b1384c8e400/0xa13c582691d3815d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa13c582691d38156 expref: 21 pid: 17126 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095500:0:18290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726100.095504:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788726100.095509:0:18290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095522:0:18290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.095530:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:3640:x1875614791572736:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1125us total) trans 0 rc 0/0 00010000:00010000:1.0:1788726100.095536:0:18290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949f600/0xa13c582691d38458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71c3 expref: 12 pid: 17128 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095548:0:18290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095555:0:18290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095579:0:18290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095587:0:18290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095593:0:18290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.095601:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788726100.095604:0:18290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095621:0:18290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ee00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:1.0:1788726100.095626:0:18290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095633:0:18290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095656:0:18290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726100.095666:0:18290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726100.095693:0:18290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:2396:x1875614770522752:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 1009us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726100.095701:0:18290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:2.0:1788726100.095775:0:20161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.095784:0:20161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726100.095790:0:20161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b13a949ee00/0xa13c582691d384c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726100.095892:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791572992:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.095937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.095969:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791573504:0@lo:400:kworker.0 00000100:00100000:3.0:1788726100.095992:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791573120:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.095999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726100.096031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.096034:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788726100.096043:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791572864:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.096089:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791573376:0@lo:400:kworker.0 00000100:00100000:3.0:1788726100.096101:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791573632:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.096171:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572992 00000100:00100000:0.0:1788726100.096176:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572992 00000100:00100000:3.0:1788726100.096192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.096217:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726100.096224:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1282598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791572736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788726100.096229:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791572992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788726100.096238:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128259aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9d482790-b071-43b8-b9fc-f5e087ab8e22:3640:1875614791572608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788726100.096259:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726100.096266:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791573248:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096281:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875614791572992:12345-0@lo:400:kworker.0 Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096288:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788726100.096295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726100.096310:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573504 00000100:00100000:0.0:1788726100.096315:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573504 00000100:00100000:0.0:1788726100.096356:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573120 00000100:00100000:0.0:1788726100.096360:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573120 00000100:00100000:0.0:1788726100.096371:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791572864 00000100:00100000:0.0:1788726100.096373:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791572864 00000100:00100000:0.0:1788726100.096384:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573376 00000100:00100000:0.0:1788726100.096386:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573376 00000100:00100000:0.0:1788726100.096398:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573632 00000100:00100000:0.0:1788726100.096401:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573632 00000100:00100000:0.0:1788726100.096414:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573248 00000100:00100000:0.0:1788726100.096416:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573248 00000100:00100000:0.0:1788726100.096458:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726100.096465:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791573504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096495:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875614791573504:12345-0@lo:400:kworker.0 Request processed in 32us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096507:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788726100.096517:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788726100.096522:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791573120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096566:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875614791573120:12345-0@lo:400:kworker.0 Request processed in 43us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096572:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788726100.096583:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788726100.096589:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791572864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096615:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875614791572864:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096621:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788726100.096633:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788726100.096638:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791573376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096661:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875614791573376:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096667:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788726100.096677:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788726100.096683:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791573632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096703:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875614791573632:12345-0@lo:400:kworker.0 Request processed in 21us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096708:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788726100.096719:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788726100.096726:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791573248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096748:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875614791573248:12345-0@lo:400:kworker.0 Request processed in 24us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726100.096760:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788726100.096812:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1875614791573248:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096824:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875614791573120:0@lo:400:kworker.0 00010000:00080000:0.0:1788726100.096835:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842af100 x1875614791573632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726100.096846:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1875614791573632:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096873:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875614791572864:0@lo:400:kworker.0 00010000:00080000:0.0:1788726100.096883:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13842ad880 x1875614791573376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788726100.096891:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1875614791573376:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096903:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1875614791572992:0@lo:400:kworker.0 00000100:00100000:0.0:1788726100.096913:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1875614791573504:0@lo:400:kworker.0 00000100:00080000:3.0:1788726100.097830:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788726100.097836:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788726100.925193:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788726101.373429:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788726101.373440:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1283378800 from 13 10000000:01000000:3.0:1788726101.373447:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788726101.373509:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.373522:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.373535:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726101.373569:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791573760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.373666:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.373725:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138643ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726101.375152:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573760 00000100:00100000:2.0:1788726101.375169:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573760 00000100:00100000:2.0:1788726101.375248:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788726101.375260:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+20:17131:x1875614791573760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726101.375494:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726101.375520:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148b200/0xa13c582691d384d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d384cf expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.375571:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148b200/0xa13c582691d384d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d384cf expref: 21 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.375584:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148b200/0xa13c582691d384d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d384cf expref: 21 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.375595:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b200, rc 0) 00000100:00100000:2.0:1788726101.375683:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791573760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 424us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.375690:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788726101.375906:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791573760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726101.375928:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.375940:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d384d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726101.376035:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791573888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.376069:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.376109:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138643ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788726101.376516:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791573888 00000100:00100000:2.0:1788726101.376523:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791573888 00000100:00100000:2.0:1788726101.376597:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788726101.376607:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791573888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726101.376751:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791573888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.376758:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788726101.377847:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791573888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.377906:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.377985:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.378037:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138643ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726101.378331:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574016 00000100:00100000:0.0:1788726101.378339:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574016 00000100:00100000:0.0:1788726101.378447:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788726101.378459:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791574016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.378603:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791574016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726101.378612:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788726101.378669:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788726101.379408:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788726101.379501:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788726101.379526:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726101.379539:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379552:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b1384c8e000/0xa13c582691d384cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726101.379563:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788726101.379567:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139d94a800 from 13 10000000:01000000:0.0:1788726101.379571:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726101.379611:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379621:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379634:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726101.379660:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.379712:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726101.379749:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726101.379770:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574144 00000100:00100000:0.0:1788726101.379776:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574144 00000100:00100000:0.0:1788726101.379807:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788726101.379817:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+21:17131:x1875614791574144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788726101.379831:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726101.379844:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13c2179400/0xa13c582691d384e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d384dd expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379882:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13c2179400/0xa13c582691d384e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d384dd expref: 22 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379893:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13c2179400/0xa13c582691d384e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d384dd expref: 22 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.379903:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179400, rc 0) 00000100:00100000:0.0:1788726101.379938:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726101.379945:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788726101.379986:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788726101.380000:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.380011:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d384e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726101.380071:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.380100:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726101.380114:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726101.380157:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574272 00000100:00100000:0.0:1788726101.380161:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574272 00000100:00100000:0.0:1788726101.380180:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788726101.380188:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.380308:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726101.380326:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788726101.380359:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.380651:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.380695:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726101.380711:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788726101.380725:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574400 00000100:00100000:0.0:1788726101.380729:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574400 00000100:00100000:0.0:1788726101.380749:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788726101.380756:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.380832:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726101.380839:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788726101.380881:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788726101.382509:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788726101.383690:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788726101.383733:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726101.383747:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.383762:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178c00/0xa13c582691d384dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726101.383775:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788726101.383780:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b139e73e000 from 13 10000000:01000000:0.0:1788726101.383783:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726101.383832:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.383855:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.383870:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726101.383907:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.383999:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726101.384063:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788726101.384256:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574528 00000100:00100000:1.0:1788726101.384266:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574528 00000100:00100000:1.0:1788726101.384335:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788726101.384349:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+22:17131:x1875614791574528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726101.384367:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726101.384383:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949fe00/0xa13c582691d384f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d384eb expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.384488:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949fe00/0xa13c582691d384f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d384eb expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.384504:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949fe00/0xa13c582691d384f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d384eb expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.384527:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fe00, rc 0) 00000100:00100000:1.0:1788726101.384590:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.384598:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788726101.384797:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726101.384816:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.384826:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d384f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726101.384905:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.384941:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.384975:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788726101.385030:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574656 00000100:00100000:1.0:1788726101.385035:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574656 00000100:00100000:1.0:1788726101.385072:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788726101.385081:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726101.385256:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.385263:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788726101.385397:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.385509:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.385559:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.385585:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726101.385599:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574784 00000100:00100000:2.0:1788726101.385606:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574784 00000100:00100000:2.0:1788726101.385638:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788726101.385647:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726101.385753:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.385761:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788726101.389713:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788726101.393798:0:20205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788726101.396381:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788726101.396451:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788726101.396469:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.396484:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178e00/0xa13c582691d384eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d384f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788726101.396497:0:17131:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788726101.396501:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b1283ea8000 from 13 10000000:01000000:0.0:1788726101.396504:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788726101.396561:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.396570:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726101.396584:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726101.396641:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788726101.396735:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726101.396804:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b139e7cbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788726101.397215:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791574912 00000100:00100000:1.0:1788726101.397226:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791574912 00000100:00100000:1.0:1788726101.397289:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788726101.397301:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+23:17131:x1875614791574912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788726101.397318:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726101.397334:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b13a949fa00/0xa13c582691d38500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa13c582691d384f9 expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.397364:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b13a949fa00/0xa13c582691d38500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa13c582691d384f9 expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.397377:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b13a949fa00/0xa13c582691d38500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa13c582691d384f9 expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726101.397388:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949fa00, rc 0) 00000100:00100000:1.0:1788726101.397470:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791574912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.397478:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788726101.397780:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791574912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726101.397801:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38500 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.397812:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa13c582691d38500 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726101.397904:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791575040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.397943:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.397976:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788726101.397997:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791575040 00000100:00100000:3.0:1788726101.398001:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791575040 00000100:00100000:3.0:1788726101.398031:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788726101.398039:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791575040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.398213:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791575040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726101.398222:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788726101.398267:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791575040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.398300:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791575168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.398344:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726101.398374:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b12824e6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788726101.398381:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791575168 00000100:00100000:2.0:1788726101.398397:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791575168 00000100:00100000:2.0:1788726101.398449:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788726101.398456:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791575168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788726101.398563:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9d482790-b071-43b8-b9fc-f5e087ab8e22:17131:1875614791575168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788726101.398702:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:17131:x1875614791575168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.398710:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000040:00080000:2.0:1788726101.400243:0:20206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788726101.400738:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788726101.400771:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788726101.400785:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38500 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.400800:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9b13c2178800/0xa13c582691d384f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa13c582691d38500 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726101.436920:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788726101.565014:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726101.565160:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770522880 00000100:00100000:3.0:1788726101.565173:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770522880 00000100:00100000:3.0:1788726101.565237:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:3.0:1788726101.565249:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+11:14906:x1875614770522880:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788726101.565466:0:17127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726101.565503:0:17127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b1384c8fc00/0xa13c582691d38507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a726b expref: -99 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.565541:0:17127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b1384c8fc00/0xa13c582691d38507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a726b expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.565553:0:17127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b1384c8fc00/0xa13c582691d38507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a726b expref: 12 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726101.565564:0:17127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8fc00, rc 0) 00000100:00100000:3.0:1788726101.565642:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770522880:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 394us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726101.565651:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 157 00000100:00100000:0.0:1788726101.567513:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726101.567592:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523008 00000100:00100000:2.0:1788726101.567605:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523008 00000100:00100000:2.0:1788726101.567672:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:2.0:1788726101.567684:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770523008:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788726101.567872:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770523008:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 189us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.567881:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 158 00000100:00100000:0.0:1788726101.575438:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726101.578600:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523136 00000100:00100000:1.0:1788726101.578622:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523136 00000100:00100000:1.0:1788726101.578711:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:1.0:1788726101.578724:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770523136:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726101.578926:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770523136:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 203us (3511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.578935:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 159 00000100:00100000:1.0:1788726101.599811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726101.602614:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523264 00000100:00100000:2.0:1788726101.602636:0:17126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523264 00000100:00100000:2.0:1788726101.602724:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:2.0:1788726101.602737:0:17126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+12:14906:x1875614770523264:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788726101.602761:0:17126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726101.602785:0:17126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b138148ba00/0xa13c582691d3850e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7272 expref: -99 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.602823:0:17126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b138148ba00/0xa13c582691d3850e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7272 expref: 13 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.602837:0:17126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b138148ba00/0xa13c582691d3850e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7272 expref: 13 pid: 17126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726101.602862:0:17126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ba00, rc 0) 00000100:00100000:2.0:1788726101.602947:0:17126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:14906:x1875614770523264:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 212us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726101.602955:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 160 00000100:00100000:1.0:1788726101.615166:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726101.615216:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523392 00000100:00100000:1.0:1788726101.615229:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523392 00000100:00100000:1.0:1788726101.615775:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:1.0:1788726101.615789:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:14906:x1875614770523392:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788726101.616004:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:14906:x1875614770523392:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 217us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.616013:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 161 00000100:00100000:0.0:1788726101.623584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726101.624108:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523520 00000100:00100000:1.0:1788726101.624134:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523520 00000100:00100000:1.0:1788726101.624216:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 162 00000100:00100000:1.0:1788726101.624227:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:14906:x1875614770523520:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788726101.624488:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:14906:x1875614770523520:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 261us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726101.624507:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 162 00010000:00010000:3.0:1788726101.955279:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788726102.971812:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788726103.664271:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726103.664639:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523648 00000100:00100000:1.0:1788726103.664650:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523648 00000100:00100000:1.0:1788726103.664723:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788726103.664734:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:15571:x1875614770523648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726103.664754:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726103.664777:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d38515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7279 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664844:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664858:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664872:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664888:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664895:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.664902:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788726103.665020:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788726103.665114:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3852a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665237:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3852a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665246:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3852a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726103.665396:0:17133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788726103.665409:0:17133:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788726103.665446:0:17133:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3852a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665457:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665463:0:17133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665471:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665477:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949ea00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788726103.665481:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665488:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665500:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:1.0:1788726103.665503:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726103.665508:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665524:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ea00/0xa13c582691d3851c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665735:0:17133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665743:0:17133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665749:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665754:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788726103.665757:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665762:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665770:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b1283236000) 00010000:00010000:1.0:1788726103.665772:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788726103.665775:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665781:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665816:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d38515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7279 expref: 8 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665841:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f200/0xa13c582691d3852a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7279 expref: 7 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726103.665849:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283236e00) 00010000:00010000:1.0:1788726103.665851:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788726103.665854:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949f200, rc 0) 00000100:00100000:1.0:1788726103.666052:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:15571:x1875614770523648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1197us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726103.666111:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788726103.672961:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726103.673162:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770523776 00000100:00100000:2.0:1788726103.673172:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770523776 00000100:00100000:2.0:1788726103.673227:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788726103.673236:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7602ce63-3b47-483e-9534-de4ec2d7c695+7:15571:x1875614770523776:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788726103.673329:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7602ce63-3b47-483e-9534-de4ec2d7c695+7:15571:x1875614770523776:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726103.673336:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788726103.687201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.687292:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524032 00000100:00100000:0.0:1788726103.687301:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524032 00000100:00100000:0.0:1788726103.687364:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788726103.687374:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+7:15571:x1875614770524032:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726103.687407:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726103.687429:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d38531 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7280 expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687498:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687510:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687521:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687534:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687552:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687558:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687653:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179c00/0xa13c582691d38546 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687661:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179c00/0xa13c582691d38546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687667:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179c00/0xa13c582691d38546 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726103.687675:0:19937:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788726103.687805:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687813:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687819:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687824:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.687828:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687835:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687854:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b1283236e00) 00010000:00010000:0.0:1788726103.687857:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.687861:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687867:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38538 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687879:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687884:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687889:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687894:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.687896:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687902:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687907:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b12819c9800) 00010000:00010000:0.0:1788726103.687909:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.687912:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.687917:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3853f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.690461:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d38531 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7280 expref: 10 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.690487:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179c00/0xa13c582691d38546 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7280 expref: 9 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.690497:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b12819c9c00) 00010000:00010000:0.0:1788726103.690499:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.690503:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179c00, rc 0) 00000100:00100000:0.0:1788726103.690571:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15571:x1875614770524032:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 3198us (3378us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788726103.690579:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788726103.700707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.700781:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524160 00000100:00100000:0.0:1788726103.700789:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524160 00000100:00100000:0.0:1788726103.700842:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:0.0:1788726103.700851:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15571:x1875614770524160:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788726103.700947:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15571:x1875614770524160:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.700955:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788726103.710858:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726103.711161:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524288 00000100:00100000:2.0:1788726103.711170:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524288 00000100:00100000:2.0:1788726103.711237:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788726103.711247:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+5:15571:x1875614770524288:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788726103.711451:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788726103.715966:0:17135:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4678us 00000100:00100000:3.0:1788726103.741181:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+5:15571:x1875614770524288:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 29927us (30323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726103.741194:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788726103.754587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.754704:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524416 00000100:00100000:0.0:1788726103.754714:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524416 00000100:00100000:0.0:1788726103.754775:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:0.0:1788726103.754784:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15577:x1875614770524416:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788726103.754803:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726103.754833:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d38554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7287 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754894:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754907:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754917:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754932:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754939:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754946:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.754994:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755002:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755008:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755015:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.755019:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755050:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755063:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:0.0:1788726103.755066:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.755071:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755077:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d3855b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755090:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755096:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755102:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755107:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.755110:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755146:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755155:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b12819c9800) 00010000:00010000:0.0:1788726103.755157:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.755161:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755177:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d38562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755211:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d38554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7287 expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755232:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:0.0:1788726103.755234:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.755238:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d38554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7287 expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.755247:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2179e00, rc 0) 00000100:00100000:0.0:1788726103.755309:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15577:x1875614770524416:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 526us (733us total) trans 0 rc 301/301 00000100:00100000:0.0:1788726103.755316:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788726103.760011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.760097:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524544 00000100:00100000:0.0:1788726103.760107:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524544 00000100:00100000:0.0:1788726103.760185:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788726103.760195:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15577:x1875614770524544:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:0.0:1788726103.760271:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15577:x1875614770524544:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.760278:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788726103.762460:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.762538:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524800 00000100:00100000:0.0:1788726103.762546:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524800 00000100:00100000:0.0:1788726103.762596:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788726103.762605:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+9:15577:x1875614770524800:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788726103.762665:0:19937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726103.762689:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d38482 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a71f4 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.762707:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:0.0:1788726103.762711:0:19937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726103.762762:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.762775:0:19937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 5 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.762783:0:19937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.762811:0:19937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 5 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.762823:0:19937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 5 pid: 17135 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726103.762836:0:19937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19937:1875614791575296:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788726103.762909:0:19937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b128361fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788726103.765539:0:19937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19937:1875614791575296:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788726103.765564:0:19937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726103.766642:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.767647:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770524928 00000100:00100000:0.0:1788726103.767671:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770524928 00010000:00010000:0.0:1788726103.767751:0:17118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 6 pid: 17135 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726103.767787:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788726103.767796:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2396:x1875614770524928:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726103.767811:0:17118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726103.767818:0:17118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 6 pid: 17135 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767831:0:17118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 6 pid: 17135 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767852:0:17118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d384c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7264 expref: 6 pid: 17135 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767870:0:17118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:0.0:1788726103.767875:0:17118:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767884:0:17118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767892:0:17118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.767942:0:17118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726103.768095:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770524928:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 299us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.768112:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1788726103.768232:0:19937:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.768240:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.768274:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.768294:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.768302:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775313:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775335:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775356:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726103.775375:0:19937:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7149318 reply state 000000009dfd6db0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775387:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775405:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:2.0:1788726103.775409:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788726103.775413:0:19937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788726103.775419:0:19937:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788726103.775426:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775432:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775439:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775458:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726103.775462:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775469:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775480:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b1283455400) 00010000:00010000:2.0:1788726103.775482:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1788726103.775484:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788726103.775486:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775491:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38569 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726103.775508:0:19937:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7149318 reply state 000000009dfd6db0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775517:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.775522:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b1283455200) 00010000:00010000:2.0:1788726103.775524:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788726103.775526:0:19937:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788726103.775621:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+10:15577:x1875614770524800:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 13012us (13165us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788726103.775629:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:3.0:1788726103.881837:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.881966:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525056 00000100:00100000:0.0:1788726103.881977:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525056 00000100:00100000:0.0:1788726103.882056:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788726103.882067:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+10:15585:x1875614770525056:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788726103.882091:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726103.882112:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d3857e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a728e expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882220:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d38585 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882234:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d38585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882247:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d38585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726103.882290:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788726103.882293:0:17134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788726103.882329:0:17134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d38585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882356:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d3857e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a728e expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882375:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178600/0xa13c582691d38585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a728e expref: 11 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.882409:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:0.0:1788726103.882412:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726103.882416:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178600, rc 0) 00000100:00100000:0.0:1788726103.882468:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+11:15585:x1875614770525056:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 402us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.882475:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788726103.933026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726103.933320:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525184 00000100:00100000:3.0:1788726103.933330:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525184 00000100:00100000:3.0:1788726103.933404:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:3.0:1788726103.933415:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+5:15586:x1875614770525184:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788726103.933437:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726103.933457:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d3858c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7295 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933518:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f800/0xa13c582691d38593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933532:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f800/0xa13c582691d38593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933542:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f800/0xa13c582691d38593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726103.933595:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788726103.933600:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788726103.933621:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f800/0xa13c582691d38593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933663:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d3858c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7295 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933679:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f800/0xa13c582691d38593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7295 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.933687:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:3.0:1788726103.933690:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788726103.933693:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f800, rc 0) 00000100:00100000:3.0:1788726103.933753:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15586:x1875614770525184:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 340us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726103.933759:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:1.0:1788726103.944217:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.944322:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525312 00000100:00100000:0.0:1788726103.944333:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525312 00000100:00100000:0.0:1788726103.944403:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:0.0:1788726103.944413:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+6:15586:x1875614770525312:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788726103.944432:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726103.944452:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d3859a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a729c expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944535:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944548:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944559:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944569:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944575:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944588:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944658:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944665:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944671:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726103.944706:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788726103.944710:0:17134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788726103.944732:0:17134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944745:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944751:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944756:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944761:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.944765:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944772:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944789:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:0.0:1788726103.944791:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.944796:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944802:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d385a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944814:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944819:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944824:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944828:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726103.944831:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944835:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944840:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b1283455200) 00010000:00010000:0.0:1788726103.944842:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726103.944844:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944849:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944883:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d3859a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a729c expref: 8 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944895:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a729c expref: 7 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.944901:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726103.944903:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726103.944906:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178a00, rc 0) 00000100:00100000:0.0:1788726103.944966:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+7:15586:x1875614770525312:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 555us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.944973:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:1.0:1788726103.951696:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726103.951789:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525440 00000100:00100000:2.0:1788726103.951799:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525440 00000100:00100000:2.0:1788726103.951878:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788726103.951904:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f6a07b65-b968-4d55-97e9-b26237de8f88+5:15586:x1875614770525440:12345-192.168.203.12@tcp:900:lfs.0 00000100:00100000:2.0:1788726103.951986:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f6a07b65-b968-4d55-97e9-b26237de8f88+5:15586:x1875614770525440:12345-192.168.203.12@tcp:900:lfs.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726103.951993:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:3.0:1788726103.952162:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788726103.965332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726103.965425:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525696 00000100:00100000:3.0:1788726103.965435:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525696 00000100:00100000:3.0:1788726103.965494:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788726103.965506:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+7:15586:x1875614770525696:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788726103.965526:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726103.965546:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d385b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72a3 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726103.965726:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788726103.965820:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d385b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72a3 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.965835:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:3.0:1788726103.965850:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788726103.965857:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d385b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72a3 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726103.965871:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ee00, rc 0) 00000100:00100000:3.0:1788726103.966688:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+8:15586:x1875614770525696:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1181us (1363us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788726103.966698:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788726103.975657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.975762:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770525952 00000100:00100000:0.0:1788726103.975772:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770525952 00000100:00100000:0.0:1788726103.975832:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788726103.975844:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+8:15586:x1875614770525952:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788726103.975897:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726103.975923:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a729c expref: 8 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.975942:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726103.975947:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726103.975968:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.975981:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.976003:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726103.976263:0:17134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015113bf8 reply state 000000004658c02a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.976276:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.976282:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726103.976284:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788726103.976287:0:17134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788726103.976294:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788726103.976376:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+9:15586:x1875614770525952:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 533us (727us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788726103.976384:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:1.0:1788726103.979987:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726103.980080:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770526208 00000100:00100000:2.0:1788726103.980089:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770526208 00000100:00100000:2.0:1788726103.980176:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788726103.980187:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+9:15586:x1875614770526208:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788726103.980391:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+10:15586:x1875614770526208:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 206us (413us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788726103.980409:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788726103.986216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726103.986302:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770526464 00000100:00100000:2.0:1788726103.986312:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770526464 00000100:00100000:2.0:1788726103.986374:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:2.0:1788726103.986385:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+10:15586:x1875614770526464:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788726103.986418:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726103.986439:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d385cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72aa expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986570:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986590:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986605:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986646:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986655:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986663:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726103.986766:0:19937:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788726103.986840:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986848:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986855:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986860:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148b600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726103.986864:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986871:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986882:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:2.0:1788726103.986885:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726103.986889:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986907:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d385d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986921:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986925:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986930:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986934:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ac00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726103.986937:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986941:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986950:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b1283455200) 00010000:00010000:2.0:1788726103.986952:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726103.986955:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986960:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d385d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.986988:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d385cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72aa expref: 12 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.987009:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:2.0:1788726103.987011:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726103.987014:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d385cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72aa expref: 12 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726103.987023:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a800, rc 0) 00000100:00100000:2.0:1788726103.987091:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+11:15586:x1875614770526464:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 708us (884us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788726103.987099:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00010000:00010000:3.0:1788726103.997058:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726103.999234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726103.999333:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770526592 00000100:00100000:0.0:1788726103.999343:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770526592 00000100:00100000:0.0:1788726103.999411:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:0.0:1788726103.999422:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+11:15586:x1875614770526592:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788726103.999445:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726103.999464:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72b1 expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999576:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999589:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999619:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726103.999645:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788726103.999648:0:17134:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788726103.999667:0:17134:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999694:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d385e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 13 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999711:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726103.999719:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726103.999722:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788726103.999724:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13c2178400, rc 0) 00000100:00100000:0.0:1788726103.999784:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+12:15586:x1875614770526592:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 365us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726103.999790:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:1.0:1788726104.003302:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.003379:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770526720 00000100:00100000:2.0:1788726104.003389:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770526720 00000100:00100000:2.0:1788726104.003447:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788726104.003457:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+12:15586:x1875614770526720:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1788726104.006968:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6a07b65-b968-4d55-97e9-b26237de8f88+12:15586:x1875614770526720:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 3502us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.006981:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788726104.014595:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.014684:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770526976 00000100:00100000:0.0:1788726104.014695:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770526976 00000100:00100000:0.0:1788726104.014755:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788726104.014767:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283688450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+12:15586:x1875614770526976:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788726104.015082:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283688450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6a07b65-b968-4d55-97e9-b26237de8f88+13:15586:x1875614770526976:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 316us (495us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788726104.015091:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000040:00080000:0.0:1788726104.064240:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788726104.085315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726104.085414:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770527104 00000100:00100000:3.0:1788726104.085423:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770527104 00000100:00100000:3.0:1788726104.085482:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:3.0:1788726104.085494:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+11:15592:x1875614770527104:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788726104.085513:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726104.085533:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d385f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72b8 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085591:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085603:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085614:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085624:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085647:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085654:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085739:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d3860a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085747:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d3860a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085754:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d3860a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726104.085785:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788726104.085788:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788726104.085825:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d3860a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085838:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085845:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085850:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085856:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8f000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726104.085860:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085874:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085888:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:3.0:1788726104.085891:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726104.085896:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085901:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d385fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085914:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085920:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085937:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085942:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b1384c8fa00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726104.085945:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085951:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085958:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b1283455200) 00010000:00010000:3.0:1788726104.085961:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726104.085964:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.085981:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d38603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.086008:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d385f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b8 expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.086020:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e800/0xa13c582691d3860a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b8 expref: 12 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.086026:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:3.0:1788726104.086028:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788726104.086031:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8e800, rc 0) 00000100:00100000:3.0:1788726104.086189:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+12:15592:x1875614770527104:12345-192.168.203.12@tcp:101:bash.0 Request processed in 697us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726104.086197:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788726104.093488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.093580:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770527232 00000100:00100000:2.0:1788726104.093589:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770527232 00000100:00100000:2.0:1788726104.093646:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788726104.093657:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7602ce63-3b47-483e-9534-de4ec2d7c695+5:15592:x1875614770527232:12345-192.168.203.12@tcp:900:bash.0 00000100:00100000:2.0:1788726104.093737:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b12833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7602ce63-3b47-483e-9534-de4ec2d7c695+5:15592:x1875614770527232:12345-192.168.203.12@tcp:900:bash.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.093744:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788726104.096336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.096418:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770527488 00000100:00100000:0.0:1788726104.096427:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770527488 00000100:00100000:0.0:1788726104.096485:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:0.0:1788726104.096496:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+12:15592:x1875614770527488:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788726104.096515:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726104.096534:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38611 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72bf expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.096639:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.096652:0:17134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.096660:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.096691:0:17134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 12 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.096704:0:17134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 12 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726104.096717:0:17134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17134:1875614791575424:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788726104.096799:0:17134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788726104.099818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.099904:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770527616 00000100:00100000:2.0:1788726104.099924:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770527616 00010000:00010000:2.0:1788726104.099975:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 13 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726104.100010:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788726104.100019:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+13:2396:x1875614770527616:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788726104.100031:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726104.100037:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 13 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.100049:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 13 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.100069:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:2.0:1788726104.100074:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.100082:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.100090:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.100108:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726104.100183:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+13:2396:x1875614770527616:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 166us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.100190:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00010000:00010000:0.0:1788726104.100703:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178400/0xa13c582691d385ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72b1 expref: 12 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726104.100734:0:17134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17134:1875614791575424:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788726104.100755:0:17134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.100763:0:17134:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.100768:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.100788:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.100798:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.100805:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101603:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101616:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101624:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788726104.101636:0:17134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788726104.101668:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101683:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101689:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101695:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2178200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726104.101699:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101707:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101719:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726104.101722:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726104.101726:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101732:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178200/0xa13c582691d38618 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788726104.101743:0:17134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020d3f6c0 reply state 000000000e90779e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101753:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101759:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b12819c9f00) 00010000:00010000:0.0:1788726104.101761:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788726104.101764:0:17134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788726104.101800:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2178a00/0xa13c582691d38611 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 15 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101821:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 14 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.101829:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726104.101831:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788726104.101833:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7e00, rc 0) 00000100:00100000:0.0:1788726104.101887:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+15:15592:x1875614770527488:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5393us (5559us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788726104.101894:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:1.0:1788726104.120921:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726104.121022:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770527744 00000100:00100000:3.0:1788726104.121032:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770527744 00000100:00100000:3.0:1788726104.121090:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788726104.121101:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+15:15592:x1875614770527744:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788726104.121165:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726104.121186:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38634 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72c6 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121260:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121273:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121299:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726104.121348:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788726104.121352:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788726104.121368:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121379:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121411:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38634 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 17 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121428:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.121437:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:3.0:1788726104.121440:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726104.121443:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8fa00, rc 0) 00000100:00100000:3.0:1788726104.121507:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+16:15592:x1875614770527744:12345-192.168.203.12@tcp:101:bash.0 Request processed in 407us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726104.121514:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:1.0:1788726104.133998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.134095:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528000 00000100:00100000:2.0:1788726104.134105:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528000 00000100:00100000:2.0:1788726104.134204:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788726104.134214:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+16:15592:x1875614770528000:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:2.0:1788726104.134529:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+17:15592:x1875614770528000:12345-192.168.203.12@tcp:35:bash.0 Request processed in 315us (537us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788726104.134537:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788726104.187816:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788726104.187839:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791575552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788726104.187905:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726104.188690:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791575552 00000100:00100000:0.0:1788726104.188700:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791575552 00000100:00100000:0.0:1788726104.188764:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788726104.188774:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791575552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788726104.188806:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726104.188863:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791575552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726104.188870:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788726104.188920:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1387635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791575552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788726104.188995:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788726104.264468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.264535:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.264567:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.264603:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.264634:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.264661:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528384 00000100:00100000:1.0:1788726104.264670:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528384 00000100:00100000:1.0:1788726104.264721:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528640 00000100:00100000:1.0:1788726104.264724:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528640 00000100:00100000:1.0:1788726104.264738:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528256 00000100:00100000:1.0:1788726104.264741:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528256 00000100:00100000:1.0:1788726104.264752:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528512 00000100:00100000:1.0:1788726104.264754:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528512 00000100:00100000:1.0:1788726104.264769:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788726104.264779:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770528384:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726104.264844:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770528384:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.264852:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788726104.264869:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788726104.264876:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770528640:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726104.264900:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770528640:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.264907:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788726104.264918:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788726104.264937:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770528256:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726104.264960:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2396:x1875614770528256:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.264975:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788726104.264987:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788726104.264993:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770528512:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726104.265015:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2396:x1875614770528512:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.265022:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788726104.265310:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528128 00000100:00100000:2.0:1788726104.265317:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528128 00000100:00100000:2.0:1788726104.265429:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00100000:2.0:1788726104.265439:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2396:x1875614770528128:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788726104.265481:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2396:x1875614770528128:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.265488:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 163 00000100:00080000:3.0:1788726104.265629:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788726104.265635:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726104.281999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.282377:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770528896 00000100:00100000:2.0:1788726104.282404:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770528896 00000100:00100000:2.0:1788726104.282467:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:2.0:1788726104.282476:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+17:15602:x1875614770528896:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788726104.282499:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726104.282517:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d38642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72cd expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726104.282786:0:17133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788726104.282884:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d38642 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72cd expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.282911:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b12819c9800) 00010000:00010000:2.0:1788726104.282914:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788726104.282919:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d38642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72cd expref: 19 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.282934:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148a800, rc 0) 00000100:00100000:2.0:1788726104.283003:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+18:15602:x1875614770528896:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 528us (1019us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788726104.283010:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788726104.287910:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.288589:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770529152 00000100:00100000:2.0:1788726104.288599:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770529152 00000100:00100000:2.0:1788726104.288646:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788726104.288656:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+18:15602:x1875614770529152:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788726104.288867:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15602:x1875614770529152:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 212us (964us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788726104.288875:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788726104.358088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726104.358276:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770529408 00000100:00100000:3.0:1788726104.358285:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770529408 00000100:00100000:3.0:1788726104.358495:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1788726104.358507:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15605:x1875614770529408:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788726104.358543:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726104.358563:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38650 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72d4 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.358665:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d38657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.358679:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d38657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.358691:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d38657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788726104.358702:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788726104.368862:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38650 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72d4 expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.368891:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d38657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72d4 expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.368901:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:3.0:1788726104.368905:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726104.368908:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8f000, rc 0) 00000100:00100000:3.0:1788726104.368987:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15605:x1875614770529408:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 10481us (10906us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788726104.368996:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:1.0:1788726104.372214:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.372889:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770529536 00000100:00100000:0.0:1788726104.372900:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770529536 00000100:00100000:0.0:1788726104.372965:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:0.0:1788726104.373192:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15605:x1875614770529536:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:0.0:1788726104.373258:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373294:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373306:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373341:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373348:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373355:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373361:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726104.373365:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373372:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373383:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726104.373385:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788726104.373390:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.373406:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d38665 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726104.373471:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15605:x1875614770529536:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 284us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726104.373484:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:1.0:1788726104.374403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.374914:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770529664 00000100:00100000:0.0:1788726104.374923:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770529664 00000100:00100000:0.0:1788726104.374993:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:0.0:1788726104.375004:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+21:2395:x1875614770529664:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788726104.375017:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726104.375038:0:20163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8f000/0xa13c582691d38657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72d4 expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.375054:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726104.375058:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788726104.375101:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+20:2395:x1875614770529664:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 99us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726104.375107:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788726104.377070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.377161:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770529920 00000100:00100000:0.0:1788726104.377170:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770529920 00000100:00100000:0.0:1788726104.377226:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788726104.377236:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+20:15605:x1875614770529920:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788726104.377456:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15605:x1875614770529920:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 221us (393us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788726104.377464:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000040:00080000:3.0:1788726104.507768:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788726104.690042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.690212:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770530176 00000100:00100000:2.0:1788726104.690222:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770530176 00000100:00100000:2.0:1788726104.690295:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788726104.690306:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15636:x1875614770530176:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:2.0:1788726104.690329:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726104.690348:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3866c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72db expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.690466:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38673 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.690507:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38673 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.690519:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38673 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726104.690532:0:19937:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788726104.690657:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d3866c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72db expref: 24 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.690676:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38673 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72db expref: 23 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.690684:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726104.690686:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788726104.690690:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ac00, rc 0) 00000100:00100000:2.0:1788726104.690752:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+23:15636:x1875614770530176:12345-192.168.203.12@tcp:101:cat.0 Request processed in 448us (719us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788726104.690758:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:3.0:1788726104.697823:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726104.697870:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.697987:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770530432 00000100:00100000:0.0:1788726104.697997:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770530432 00000100:00100000:0.0:1788726104.698064:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788726104.698075:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+23:15636:x1875614770530432:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:0.0:1788726104.698429:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128259aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+24:15636:x1875614770530432:12345-192.168.203.12@tcp:35:cat.0 Request processed in 355us (615us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788726104.698438:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788726104.700381:0:18290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770530560 00000100:00100000:1.0:1788726104.700402:0:18290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770530560 00000100:00100000:1.0:1788726104.700469:0:18290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788726104.700480:0:18290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+24:2395:x1875614770530560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726104.700506:0:18290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726104.700531:0:18290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38673 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72db expref: 24 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.700548:0:18290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726104.700553:0:18290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726104.700608:0:18290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+23:2395:x1875614770530560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 129us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.700629:0:18290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:0.0:1788726104.771344:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.771519:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770530816 00000100:00100000:2.0:1788726104.771530:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770530816 00000100:00100000:2.0:1788726104.771590:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:2.0:1788726104.771600:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+23:15642:x1875614770530816:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788726104.771624:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726104.771644:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d38681 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72e2 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771769:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771784:0:17133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771792:0:17133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771799:0:17133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771831:0:17133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771844:0:17133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 24 pid: 17135 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726104.771858:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17133:1875614791575680:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788726104.771946:0:17133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 24 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.771956:0:17133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 24 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726104.771966:0:17133:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17133:1875614791575808:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788726104.772000:0:17133:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726104.775803:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.775890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.775981:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770530944 00000100:00100000:1.0:1788726104.775990:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770530944 00010000:00010000:1.0:1788726104.776026:0:20163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 25 pid: 17135 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726104.776063:0:20163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531072 00000100:00100000:1.0:1788726104.776067:0:20163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531072 00010000:00010000:1.0:1788726104.776080:0:20163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 26 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726104.776103:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788726104.776113:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+26:2395:x1875614770530944:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726104.776163:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726104.776171:0:20163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 26 pid: 17135 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776184:0:20163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 26 pid: 17135 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776206:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726104.776212:0:20163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776219:0:20163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776225:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726104.776285:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+26:2395:x1875614770530944:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 172us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.776292:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788726104.776311:0:20163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788726104.776318:0:20163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13881e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+25:2395:x1875614770531072:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726104.776326:0:20163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726104.776332:0:20163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 25 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776342:0:20163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 25 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776359:0:20163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726104.776362:0:20163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776369:0:20163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776376:0:20163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776402:0:20163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726104.776426:0:20163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13881e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+25:2395:x1875614770531072:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 107us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.776431:0:20163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00010000:00010000:2.0:1788726104.776480:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8fa00/0xa13c582691d3863b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72c6 expref: 24 pid: 17135 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726104.776503:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17133:1875614791575680:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726104.776610:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38626 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72bf expref: 23 pid: 17134 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726104.776634:0:17133:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17133:1875614791575808:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726104.776655:0:17133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776664:0:17133:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776670:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726104.776688:0:17133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788726104.776831:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d38681 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e2 expref: 24 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776847:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b600/0xa13c582691d38688 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e2 expref: 23 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.776855:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726104.776857:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788726104.776859:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b600, rc 0) 00000100:00100000:1.0:1788726104.776883:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+23:15642:x1875614770530816:12345-192.168.203.12@tcp:101:dd.0 Request processed in 5286us (5550us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788726104.776890:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788726104.780244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.780687:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531200 00000100:00100000:2.0:1788726104.780697:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531200 00000100:00100000:2.0:1788726104.780792:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:2.0:1788726104.780803:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+23:15642:x1875614770531200:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788726104.780826:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726104.780845:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38696 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72e9 expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.780885:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.780899:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.780910:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.781040:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d38696 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 25 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.781060:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 24 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.781081:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726104.781084:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788726104.781087:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148b000, rc 0) 00000100:00100000:2.0:1788726104.781175:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1282598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+24:15642:x1875614770531200:12345-192.168.203.12@tcp:101:dd.0 Request processed in 373us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.781182:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:3.0:1788726104.787292:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726104.787797:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531456 00000100:00100000:0.0:1788726104.787808:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531456 00000100:00100000:0.0:1788726104.787869:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788726104.787881:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+24:15642:x1875614770531456:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:0.0:1788726104.788098:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.788150:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.788162:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788726104.788208:0:17134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788726104.788231:0:17134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000250e8e2c reply state 000000006c4c69da transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.788244:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726104.788251:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726104.788254:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788726104.788257:0:17134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726104.788357:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770531456:12345-192.168.203.12@tcp:36:dd.0 Request processed in 478us (1073us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788726104.788365:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000020:00080000:0.0:1788726104.788369:0:17134:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788726104.790918:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726104.791436:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531584 00000100:00100000:3.0:1788726104.791447:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531584 00000100:00100000:3.0:1788726104.791546:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788726104.791557:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770531584:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788726104.791579:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726104.791598:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d386ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72f0 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.791650:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f0 expref: 28 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.791665:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f0 expref: 28 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726104.791683:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:3.0:1788726104.791686:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788726104.791690:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ee00, rc 0) 00000100:00100000:3.0:1788726104.791742:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1387634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15642:x1875614770531584:12345-192.168.203.12@tcp:101:dd.0 Request processed in 186us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726104.791749:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:3.0:1788726104.807713:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.807815:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531840 00000100:00100000:2.0:1788726104.807824:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531840 00000100:00100000:2.0:1788726104.807891:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788726104.807903:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15642:x1875614770531840:12345-192.168.203.12@tcp:103:dd.0 00010000:00010000:2.0:1788726104.807917:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726104.808054:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d386ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f0 expref: 28 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.808073:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726104.808078:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788726104.808174:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770531840:12345-192.168.203.12@tcp:103:dd.0 Request processed in 273us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.808181:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:0.0:1788726104.810351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726104.810449:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770531968 00000100:00100000:1.0:1788726104.810459:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770531968 00000100:00100000:1.0:1788726104.810522:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:1.0:1788726104.810532:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770531968:12345-192.168.203.12@tcp:58:dd.0 00010000:00010000:1.0:1788726104.810644:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.810660:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726104.810671:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788726104.812034:0:17133:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788726104.813592:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788726104.813776:0:17133:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788726104.813932:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770531968:12345-192.168.203.12@tcp:58:dd.0 Request processed in 3396us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726104.813943:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788726104.820067:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726104.820646:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532096 00000100:00100000:2.0:1788726104.820666:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532096 00000100:00100000:2.0:1788726104.820726:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788726104.820737:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+27:15642:x1875614770532096:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:2.0:1788726104.820758:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726104.820778:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72f7 expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820846:0:19937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820857:0:19937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 28 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820876:0:19937:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820890:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 28 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820902:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726104.820905:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726104.820908:0:19937:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 28 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726104.820915:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b138148ac00, rc 0) 00000100:00100000:2.0:1788726104.820974:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15642:x1875614770532096:12345-192.168.203.12@tcp:101:dd.0 Request processed in 238us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726104.820980:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00010000:00010000:3.0:1788726105.019323:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788726105.084237:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788726105.211368:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791575936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788726105.211459:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726105.211531:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791575936 00000100:00100000:0.0:1788726105.211539:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791575936 00000100:00100000:0.0:1788726105.211594:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726105.211604:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791575936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788726105.211624:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788726105.211681:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791575936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.211688:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788726105.211735:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791575936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788726105.212280:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788726105.212292:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791576192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788726105.212323:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.212352:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788726105.212360:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b1283695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791576064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788726105.212385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.212423:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576192 00000100:00100000:1.0:1788726105.212428:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576192 00000100:00100000:1.0:1788726105.212466:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788726105.212476:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791576192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788726105.212496:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788726105.212531:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791576192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.212537:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788726105.212587:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791576192:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788726105.212853:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788726105.212857:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788726105.212862:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788726105.212870:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791576320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788726105.212916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726105.212945:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576064 00000100:00100000:3.0:1788726105.212949:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576064 00000100:00100000:3.0:1788726105.212976:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576320 00000100:00100000:3.0:1788726105.212979:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576320 00000100:00100000:3.0:1788726105.212993:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788726105.213000:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791576064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788726105.213023:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788726105.213058:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791576064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.213065:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788726105.213078:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788726105.213084:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791576320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788726105.213098:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788726105.213159:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791576320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.213164:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788726105.213195:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b1283695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791576064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788726105.213216:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791576320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788726105.214185:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788726105.214198:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791576448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788726105.214241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.214408:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576448 00000100:00100000:1.0:1788726105.214415:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576448 00000100:00100000:1.0:1788726105.214551:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788726105.214560:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791576448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788726105.214576:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788726105.214607:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1875614791576448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.214613:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788726105.215028:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1875614791576448:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788726105.215098:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788726105.215243:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791576832:0@lo:400:kworker.0 00000100:00100000:2.0:1788726105.215525:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791576576:0@lo:400:kworker.0 00000100:00100000:2.0:1788726105.215581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726105.215619:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791577088:0@lo:400:kworker.0 00000100:00100000:2.0:1788726105.215646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.215721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.215742:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791577344:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.215768:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791576960:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.215796:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576832 00000100:00100000:1.0:1788726105.215800:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576832 00000100:00100000:1.0:1788726105.215849:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788726105.215858:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791576832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.215978:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791576704:0@lo:400:kworker.0 00000100:00100000:3.0:1788726105.216079:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576576 00000100:00100000:3.0:1788726105.216083:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576576 00000100:00100000:3.0:1788726105.216114:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788726105.216142:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3639:x1875614791576576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.219531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726105.219589:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791577216:0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.219628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788726105.219705:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791577088 00000100:00100000:0.0:1788726105.219713:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791577088 00000100:00100000:0.0:1788726105.219771:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576704 00000100:00100000:0.0:1788726105.219774:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576704 00000100:00100000:0.0:1788726105.219806:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791577216 00000100:00100000:0.0:1788726105.219809:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791577216 00000100:00100000:0.0:1788726105.219823:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788726105.219830:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791577088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220482:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875614791576832:12345-0@lo:400:kworker.0 Request processed in 4622us (4758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.220493:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788726105.220534:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788726105.220544:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791576704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220584:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875614791576704:12345-0@lo:400:kworker.0 Request processed in 42us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.220591:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788726105.220616:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788726105.220624:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791577216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220662:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875614791577216:12345-0@lo:400:kworker.0 Request processed in 40us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.220668:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788726105.220706:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875614791576704:0@lo:400:kworker.0 00010000:00080000:1.0:1788726105.220720:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af861f80 x1875614791577216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788726105.220730:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1875614791577216:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.220814:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1875614791576832:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.220851:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791577472:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.220881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.220902:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791577344 00000100:00100000:1.0:1788726105.220911:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791577344 00000100:00100000:1.0:1788726105.220933:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791576960 00000100:00100000:1.0:1788726105.220935:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791576960 00000100:00100000:1.0:1788726105.221037:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791577472 00000100:00100000:1.0:1788726105.221040:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791577472 00000100:00100000:0.0:1788726105.221053:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875614791577088:12345-0@lo:400:kworker.0 Request processed in 49us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.221055:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788726105.221060:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788726105.221061:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791577344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.221097:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788726105.221104:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.221161:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875614791576960:12345-0@lo:400:kworker.0 Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.221168:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788726105.221193:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875614791576960:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.221205:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875614791577344:12345-0@lo:400:kworker.0 Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.221210:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788726105.221216:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791577472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788726105.221273:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1875614791577088:0@lo:400:kworker.0 00000100:00080000:2.0:1788726105.221316:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788726105.221319:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875614791577472:12345-0@lo:400:kworker.0 Request processed in 103us (437us total) trans 0 rc 0/0 00000100:00080000:2.0:1788726105.221320:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788726105.226496:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9b13af863b80 x1875614791577472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788726121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788726105.226514:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1875614791577472:0@lo:400:kworker.0 00000100:00100000:1.0:1788726105.226609:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788726105.226666:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af860e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1875614791577344:0@lo:400:kworker.0 00000100:00100000:3.0:1788726105.226837:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d482790-b071-43b8-b9fc-f5e087ab8e22+24:3639:x1875614791576576:12345-0@lo:400:kworker.0 Request processed in 10693us (11252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.226855:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788726105.227310:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9d482790-b071-43b8-b9fc-f5e087ab8e22:3639:1875614791576576:0@lo:400:kworker.0 00000100:00100000:0.0:1788726105.227384:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000040:00080000:3.0:1788726105.531327:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788726105.531336:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726105.531364:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788726105.531392:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788726105.531793:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af863100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17167:1875614791577600:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788726105.531897:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1387e0fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788726105.543723:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.545426:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af863100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17167:1875614791577600:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788726105.548036:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532224 00000100:00100000:1.0:1788726105.548052:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532224 00000100:00100000:1.0:1788726105.548171:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:1.0:1788726105.548187:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15644:x1875614770532224:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788726105.548218:0:19937:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788726105.548347:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15644:x1875614770532224:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 163us (4632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.548355:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00080000:2.0:1788726105.548769:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788726105.559472:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.562053:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532352 00000100:00100000:2.0:1788726105.562203:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532352 00000100:00100000:2.0:1788726105.562339:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:2.0:1788726105.562350:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15644:x1875614770532352:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788726105.562429:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562444:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562457:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562606:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562632:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562639:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562675:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562684:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562691:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726105.562733:0:17135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788726105.562738:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788726105.562764:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562775:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562781:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562787:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562792:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a400 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.562796:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562808:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562821:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b12819c9c00) 00010000:00010000:2.0:1788726105.562824:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726105.562828:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562834:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a400/0xa13c582691d386c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562848:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562854:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562859:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562863:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.562866:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562871:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562877:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b1283455400) 00010000:00010000:2.0:1788726105.562879:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726105.562881:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562895:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a800/0xa13c582691d386c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562910:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562927:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562934:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562939:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13bd610000 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.562943:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562949:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562957:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726105.562960:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788726105.562963:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.562968:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610000/0xa13c582691d386ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726105.563058:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15644:x1875614770532352:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 708us (3602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.564487:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788726105.568654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726105.568863:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532608 00000100:00100000:1.0:1788726105.568874:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532608 00000100:00100000:1.0:1788726105.568943:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788726105.568955:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+28:15644:x1875614770532608:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788726105.568977:0:19937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726105.568996:0:19937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ee00/0xa13c582691d386d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a72fe expref: -99 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569108:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569140:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569151:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788726105.569162:0:19937:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788726105.569239:0:19937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569257:0:19937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569263:0:19937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569268:0:19937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:1.0:1788726105.569272:0:19937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569278:0:19937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569289:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726105.569292:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788726105.569296:0:19937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569302:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f600/0xa13c582691d386dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569341:0:19937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ee00/0xa13c582691d386d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72fe expref: 30 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569351:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b12819c9c00) 00010000:00010000:1.0:1788726105.569353:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788726105.569357:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949ee00/0xa13c582691d386d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72fe expref: 30 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.569366:0:19937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949ee00, rc 0) 00000100:00100000:1.0:1788726105.569438:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+29:15644:x1875614770532608:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 484us (792us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788726105.569445:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788726105.580453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.580683:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532736 00000100:00100000:0.0:1788726105.580694:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532736 00000100:00100000:0.0:1788726105.580756:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788726105.580769:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+29:15644:x1875614770532736:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788726105.580804:0:17134:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788726105.580911:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+29:15644:x1875614770532736:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 145us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.581003:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:1.0:1788726105.586885:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.587581:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770532992 00000100:00100000:3.0:1788726105.587592:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770532992 00000100:00100000:3.0:1788726105.587655:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788726105.587665:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+29:15644:x1875614770532992:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726105.587684:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726105.587703:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e400/0xa13c582691d386ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7305 expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788726105.588089:0:17133:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1788726105.588096:0:17133:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788726105.588161:0:17133:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788726105.588485:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ec00/0xa13c582691d386f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.588499:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ec00/0xa13c582691d386f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.588511:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ec00/0xa13c582691d386f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.588634:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e400/0xa13c582691d386ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7305 expref: 32 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.588651:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ec00/0xa13c582691d386f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7305 expref: 31 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.588659:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f100) 00010000:00010000:3.0:1788726105.588662:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788726105.588665:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ec00, rc 0) 00000100:00100000:3.0:1788726105.588728:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+31:15644:x1875614770532992:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1064us (1853us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788726105.588736:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788726105.595379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.595485:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770533248 00000100:00100000:0.0:1788726105.595495:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770533248 00000100:00100000:0.0:1788726105.595559:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788726105.595570:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+31:15644:x1875614770533248:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726105.595623:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788726105.595647:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ec00/0xa13c582691d386f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7305 expref: 31 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595666:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f100) 00010000:00010000:0.0:1788726105.595675:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788726105.595697:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595711:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595720:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595733:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595740:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595746:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595803:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595810:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595816:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595821:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7a00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726105.595825:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595832:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595841:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:0.0:1788726105.595843:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726105.595847:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595853:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7a00/0xa13c582691d386ff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595862:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595868:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595873:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595886:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726105.595889:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595895:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595904:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5db14b03 (ffff9b12819c9400) 00010000:00010000:0.0:1788726105.595906:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726105.595909:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.595914:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d38706 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5db14b03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726105.596022:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+30:15644:x1875614770533248:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 454us (652us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788726105.596030:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1788726105.600514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.600777:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770533376 00000100:00100000:3.0:1788726105.600788:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770533376 00000100:00100000:3.0:1788726105.600845:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:3.0:1788726105.600855:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+30:15644:x1875614770533376:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726105.600874:0:17133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726105.600895:0:17133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e400/0xa13c582691d3870d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a730c expref: -99 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601047:0:17133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38714 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601061:0:17133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601263:0:17133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601635:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8e400/0xa13c582691d3870d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a730c expref: 32 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601655:0:17133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b1384c8ee00/0xa13c582691d38714 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a730c expref: 31 pid: 17133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.601664:0:17133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:3.0:1788726105.601667:0:17133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788726105.601671:0:17133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8ee00, rc 0) 00000100:00100000:3.0:1788726105.601780:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+31:15644:x1875614770533376:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 925us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.601787:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:2.0:1788726105.613974:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.614079:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770533632 00000100:00100000:0.0:1788726105.614090:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770533632 00000100:00100000:0.0:1788726105.614176:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788726105.614187:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+31:15644:x1875614770533632:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788726105.614287:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.614303:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.614316:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788726105.614737:0:17134:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788726105.614747:0:17134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 550770629764ns, next at 551770627264ns, rc = 0 00000004:00010000:0.0:1788726105.614797:0:17134:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099e6b6fb reply state 000000009fcf489e transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.614811:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.614819:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:0.0:1788726105.614822:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788726105.614826:0:17134:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788726105.614925:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+33:15644:x1875614770533632:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 739us (959us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788726105.614933:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:0.0:1788726105.619451:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.619714:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770533760 00000100:00100000:2.0:1788726105.619723:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770533760 00000100:00100000:2.0:1788726105.619779:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788726105.619789:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+33:15644:x1875614770533760:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726105.619810:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726105.619828:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7313 expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.619881:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 34 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.619895:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 34 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.619915:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.619918:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726105.619922:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13bd611c00, rc 0) 00000100:00100000:2.0:1788726105.619982:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+34:15644:x1875614770533760:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 194us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.619990:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:2.0:1788726105.623447:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.623853:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770533888 00000100:00100000:3.0:1788726105.623863:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770533888 00000100:00100000:3.0:1788726105.623928:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788726105.623938:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770533888:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788726105.624195:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2395:x1875614770533888:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 258us (756us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788726105.624202:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788726105.627328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.627454:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770534144 00000100:00100000:0.0:1788726105.627464:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770534144 00000100:00100000:0.0:1788726105.627515:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788726105.627524:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+34:15644:x1875614770534144:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788726105.627723:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+35:15644:x1875614770534144:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 200us (403us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788726105.627731:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:1.0:1788726105.630728:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.630786:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770534400 00000100:00100000:0.0:1788726105.630795:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770534400 00000100:00100000:0.0:1788726105.630846:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788726105.630858:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+35:15644:x1875614770534400:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788726105.631183:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+35:15644:x1875614770534400:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 327us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.631191:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788726105.633990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.634063:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770534528 00000100:00100000:2.0:1788726105.634072:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770534528 00000100:00100000:2.0:1788726105.634162:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:2.0:1788726105.634173:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+35:15644:x1875614770534528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788726105.634193:0:17135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788726105.634224:0:17135:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d38729 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a731a expref: -99 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634318:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634331:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634342:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788726105.634394:0:17135:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788726105.634413:0:17135:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634438:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d38729 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a731a expref: 37 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634454:0:17135:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a731a expref: 36 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.634462:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.634465:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788726105.634469:0:17135:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13bd610600, rc 0) 00000100:00100000:2.0:1788726105.634515:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+36:15644:x1875614770534528:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 343us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.634523:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:3.0:1788726105.639254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.639362:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770534656 00000100:00100000:0.0:1788726105.639371:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770534656 00000100:00100000:0.0:1788726105.639436:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:0.0:1788726105.639446:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+6:2396:x1875614770534656:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788726105.639462:0:19540:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788726105.639481:0:19540:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7321 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788726105.639503:0:19540:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9dcb58, blocks: 0x0 00010000:00010000:0.0:1788726105.639520:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1788726105.639524:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726105.639533:0:19540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 7 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.639554:0:19540:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 7 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.639567:0:19540:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13be9a7a00, rc 0) 00000100:00100000:0.0:1788726105.639621:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2396:x1875614770534656:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 177us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.639628:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788726105.648036:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.648193:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770534912 00000100:00100000:2.0:1788726105.648203:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770534912 00000100:00100000:2.0:1788726105.648267:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788726105.648276:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+36:15644:x1875614770534912:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788726105.648379:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+36:15644:x1875614770534912:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.648395:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788726105.651478:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726105.652865:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535040 00000100:00100000:1.0:1788726105.652877:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535040 00000100:00100000:1.0:1788726105.653147:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788726105.653158:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+36:15644:x1875614770535040:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788726105.656786:0:17113:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788726105.656816:0:17113:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788726105.656927:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.656951:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.656959:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.656965:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148ae00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726105.656969:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.656977:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.656993:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b1283455200) 00010000:00010000:3.0:1788726105.656996:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726105.657002:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657008:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ae00/0xa13c582691d38570 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657028:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657035:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657040:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657046:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b138148a200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726105.657055:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657061:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657071:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:3.0:1788726105.657073:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726105.657076:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657082:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148a200/0xa13c582691d38577 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657094:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657101:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657107:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657112:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726105.657114:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657155:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657164:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b12819c9f00) 00010000:00010000:3.0:1788726105.657166:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726105.657188:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657195:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179e00/0xa13c582691d3861f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657212:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657219:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657225:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657230:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726105.657233:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657238:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657247:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:3.0:1788726105.657250:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788726105.657253:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657258:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a6e00/0xa13c582691d386a4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657268:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657283:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657290:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657295:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:3.0:1788726105.657298:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657304:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657313:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:3.0:1788726105.657315:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788726105.657318:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.657324:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7200/0xa13c582691d3871b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726105.657643:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788726105.657660:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13af864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791577728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788726105.657740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.657906:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791577728 00000100:00100000:1.0:1788726105.657914:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791577728 00000100:00100000:1.0:1788726105.657961:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788726105.657971:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875614791577728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788726105.658087:0:19181:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788726105.658090:0:19181:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788726105.658092:0:19181:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788726105.658094:0:19181:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788726104 -> 1788726104 00002000:00010000:1.0:1788726105.658097:0:19181:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1788726105.658213:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b13af864380/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788726105.658220:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13af864380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1875614791577728:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788726105.658463:0:17113:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788726105.661355:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661371:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661378:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661394:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13c2179600 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.661398:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661406:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661421:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b1283455c00) 00010000:00010000:2.0:1788726105.661424:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788726105.661428:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.661434:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13c2179600/0xa13c582691d385c4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726105.664159:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+15:15644:x1875614770535040:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 10992us (12678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.664174:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:1.0:1788726105.665195:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875614791577728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7218us (7448us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788726105.665207:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788726105.668372:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.668428:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535168 00000100:00100000:2.0:1788726105.668438:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535168 00000100:00100000:2.0:1788726105.668497:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:2.0:1788726105.668509:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2395:x1875614770535168:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788726105.668616:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2395:x1875614770535168:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.668625:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:0.0:1788726105.671922:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.672024:0:19937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535424 00000100:00100000:2.0:1788726105.672034:0:19937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535424 00000100:00100000:2.0:1788726105.672149:0:19937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:2.0:1788726105.672159:0:19937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+15:15644:x1875614770535424:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788726105.672208:0:19937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788726105.672232:0:19937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610600/0xa13c582691d38730 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a731a expref: 15 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.672250:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.672254:0:19937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788726105.672279:0:19937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d3873e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.672290:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d3873e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.672313:0:19937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d3873e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788726105.672535:0:19937:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b921b2b5 reply state 0000000057e0d706 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d3873e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.672547:0:19937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611600/0xa13c582691d3873e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.672554:0:19937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.672556:0:19937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788726105.672558:0:19937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788726105.673435:0:19937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+16:15644:x1875614770535424:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1270us (1514us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788726105.673445:0:19937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1788726105.676675:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.677877:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535552 00000100:00100000:3.0:1788726105.677890:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535552 00000100:00100000:3.0:1788726105.677956:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:3.0:1788726105.677967:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139daf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+7:15644:x1875614770535552:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788726105.678000:0:18642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788726105.678019:0:18642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a7328 expref: -99 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.678335:0:18642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 8 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.678346:0:18642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726105.678351:0:18642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726105.678365:0:18642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 8 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.678417:0:18642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 8 pid: 19540 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.678431:0:18642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 8 pid: 19540 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726105.678453:0:18642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18642:1875614791577856:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788726105.678532:0:18642:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788726105.685177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726105.685261:0:18290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535680 00000100:00100000:1.0:1788726105.685270:0:18290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535680 00010000:00010000:1.0:1788726105.685307:0:18290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 9 pid: 19540 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.685352:0:18290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788726105.685361:0:18290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+9:2395:x1875614770535680:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726105.685376:0:18290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726105.685409:0:18290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 9 pid: 19540 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.685423:0:18290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 9 pid: 19540 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.685450:0:18290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726105.685454:0:18290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726105.685461:0:18290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.685470:0:18290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.685524:0:18290:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.685539:0:18290:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18290:1875614791577984:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788726105.685614:0:18642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c75a1060/0xa13c582691d38737 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7321 expref: 9 pid: 19540 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726105.685627:0:18642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18642:1875614791577856:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788726105.685633:0:18290:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7480 going to sleep for 11 seconds 00010000:00010000:0.0:1788726105.685650:0:18642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 8 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.685663:0:18642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b1384c8e400, rc 0) 00000100:00100000:0.0:1788726105.685691:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139daf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+8:15644:x1875614770535552:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 7726us (9024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.685697:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788726105.689364:0:18290:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7af100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18290:1875614791577984:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788726105.689398:0:18290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788726105.689463:0:18290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2395:x1875614770535680:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4101us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.689473:0:18290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788726105.692572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726105.692703:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535808 00000100:00100000:1.0:1788726105.692712:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535808 00000100:00100000:1.0:1788726105.692768:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:1.0:1788726105.692778:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2395:x1875614770535808:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788726105.693164:0:19181:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788726105.693168:0:19181:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788726104 00002000:00010000:1.0:1788726105.693170:0:19181:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788726103 00002000:00010000:1.0:1788726105.693172:0:19181:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788726104 -> 1788726104 00002000:00010000:1.0:1788726105.693175:0:19181:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788726105.693224:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+8:2395:x1875614770535808:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 447us (659us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788726105.693231:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788726105.696015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.696446:0:19540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770535936 00000100:00100000:0.0:1788726105.696456:0:19540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770535936 00000100:00100000:0.0:1788726105.696516:0:19540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788726105.696527:0:19540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+8:2396:x1875614770535936:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788726105.696569:0:19540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.696589:0:19540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 8 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.696598:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788726105.696603:0:19540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788726105.696621:0:19540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.696656:0:19540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 8 pid: 18642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.696670:0:19540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 8 pid: 18642 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726105.696685:0:19540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19540:1875614791578112:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788726105.697456:0:19540:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13874bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726105.706416:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726105.706458:0:19540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:19540:1875614791578112:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788726105.706487:0:19540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.706494:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536064 00000100:00100000:1.0:1788726105.706503:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536064 00010000:00010000:1.0:1788726105.706544:0:17119:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.706759:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788726105.706782:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b128367d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+9:2396:x1875614770536064:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788726105.706809:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788726105.706829:0:17119:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.706842:0:17119:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.706876:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086573075/0xa13c582691d38745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7328 expref: 9 pid: 18642 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.706895:0:17119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726105.706900:0:17119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788726105.706905:0:17119:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.706916:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.706948:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788726105.707005:0:19540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707014:0:19540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707032:0:19540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707040:0:19540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707049:0:19540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707055:0:19540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a6e00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726105.707059:0:19540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707068:0:19540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707105:0:19540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.707114:0:19540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfac437a/0xa13c582691d3874c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.711187:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b128367d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+8:2396:x1875614770536064:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 4408us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.711202:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788726105.711492:0:19540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2396:x1875614770535936:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 14964us (15482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726105.711500:0:19540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788726105.715406:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.715447:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536320 00000100:00100000:3.0:1788726105.715456:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536320 00000100:00100000:2.0:1788726105.716375:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 63 00000100:00100000:2.0:1788726105.716407:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+16:15644:x1875614770536320:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788726105.716495:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.716512:0:17135:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 16 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.716522:0:17135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.716553:0:17135:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 16 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.717742:0:17135:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 16 pid: 19937 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726105.717765:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578240:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788726105.718312:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed300 going to sleep for 11 seconds 00000100:00100000:2.0:1788726105.723350:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.723425:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536448 00000100:00100000:3.0:1788726105.723434:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536448 00010000:00010000:3.0:1788726105.723473:0:17120:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 17 pid: 19937 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726105.723515:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788726105.723526:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+17:2395:x1875614770536448:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726105.723539:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726105.723546:0:17120:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 17 pid: 19937 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723557:0:17120:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 17 pid: 19937 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723589:0:17120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:3.0:1788726105.723596:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 17 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723624:0:17120:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723633:0:17120:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723640:0:17120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.723661:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726105.723716:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+17:2395:x1875614770536448:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 191us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.723723:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00010000:00010000:1.0:1788726105.725002:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148b000/0xa13c582691d3869d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72e9 expref: 16 pid: 19937 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.725043:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578240:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726105.725064:0:17135:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725074:0:17135:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725079:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725476:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725490:0:17135:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725572:0:17135:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725659:0:17135:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 16 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.725673:0:17135:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 16 pid: 17135 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.725687:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578368:192.168.203.12@tcp:104: 00000100:00100000:1.0:1788726105.725809:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b138a1c7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788726105.729633:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726105.729742:0:18290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536576 00000100:00100000:3.0:1788726105.729751:0:18290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536576 00010000:00010000:3.0:1788726105.729789:0:18290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 17 pid: 17135 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726105.729828:0:18290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788726105.729838:0:18290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+17:2395:x1875614770536576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788726105.729851:0:18290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788726105.729858:0:18290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 17 pid: 17135 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.729870:0:18290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 17 pid: 17135 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.729908:0:18290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:3.0:1788726105.729914:0:18290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.729934:0:18290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.729941:0:18290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726105.729959:0:18290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788726105.730023:0:18290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+17:2395:x1875614770536576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 186us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.730029:0:18290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00010000:00010000:1.0:1788726105.732061:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd611c00/0xa13c582691d38722 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a7313 expref: 16 pid: 17135 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788726105.732728:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578368:192.168.203.12@tcp:104: 00010000:00010000:1.0:1788726105.732756:0:17135:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.732768:0:17135:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.732775:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788726105.732884:0:17135:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788726105.733019:0:17135:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788726105.733055:0:17135:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788726105.733167:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b139e7aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17135:1875614791578496:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788726105.734689:0:17135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788726105.734739:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b13856bb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726105.735033:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791578496 00000100:00100000:3.0:1788726105.735042:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791578496 00000100:00100000:3.0:1788726105.735106:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788726105.735140:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17135:x1875614791578496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788726105.735250:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17135:x1875614791578496:12345-0@lo:1000:mdt00_002.0 Request processed in 136us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726105.735256:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788726105.735345:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b139e7aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17135:1875614791578496:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788726105.735525:0:17135:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788726105.735602:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17135:1875614791578624:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788726105.735636:0:17135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788726105.735662:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788726105.737112:0:17892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791578624 00000100:00100000:3.0:1788726105.737157:0:17892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791578624 00000100:00100000:3.0:1788726105.737205:0:17892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788726105.737215:0:17892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17135:x1875614791578624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788726105.737375:0:17892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17135:x1875614791578624:12345-0@lo:1000:mdt00_002.0 Request processed in 161us (1737us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788726105.737408:0:17892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788726105.737747:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17135:1875614791578624:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788726105.737791:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737802:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737810:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737816:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949e200 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.737820:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737840:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737855:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.737857:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726105.737861:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737867:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d3875a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737896:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737903:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737908:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737930:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f800 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:2.0:1788726105.737933:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737939:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737946:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:2.0:1788726105.737948:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788726105.737955:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 19 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737977:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 19 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.737986:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 19 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.738042:0:17135:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b138148ac00/0xa13c582691d386b9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a72f7 expref: 19 pid: 19937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788726105.738055:0:17135:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578752:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788726105.738163:0:17135:0:(client.c:2715:ptlrpc_set_wait()) set ffff9b1384bed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788726105.748448:0:17135:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b13842ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17135:1875614791578752:192.168.203.12@tcp:105: 00010000:00010000:0.0:1788726105.748478:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748489:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d386b2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748523:0:17135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748535:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748545:0:17135:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748554:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748574:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748590:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748596:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726105.748600:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748608:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748621:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726105.748624:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788726105.748627:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748633:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38761 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748643:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748648:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748654:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748659:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13bd610e00 already unused, calling callback (ffffffffc18724f0) 00010000:00010000:0.0:1788726105.748669:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748675:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748683:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:0.0:1788726105.748686:0:17135:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788726105.748688:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.748693:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13bd610e00/0xa13c582691d38753 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726105.748863:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15644:x1875614770536320:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 32465us (33463us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788726105.748873:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 63 00000020:00080000:0.0:1788726105.748879:0:17135:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788726105.749231:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788726105.749236:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788726105.749251:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788726105.749257:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788726105.749948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.750142:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536704 00000100:00100000:0.0:1788726105.750151:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536704 00000100:00100000:0.0:1788726105.750191:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788726105.750201:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283688050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15642:x1875614770536704:12345-192.168.203.12@tcp:49:dd.0 00000100:00100000:0.0:1788726105.750314:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283688050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15642:x1875614770536704:12345-192.168.203.12@tcp:49:dd.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788726105.750321:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788726105.771032:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.771151:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770536960 00000100:00100000:0.0:1788726105.771161:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770536960 00000100:00100000:0.0:1788726105.771231:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788726105.771243:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+19:15644:x1875614770536960:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788726105.771537:0:17137:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788726105.771567:0:17137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788726105.771613:0:17137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771629:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771641:0:17137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771648:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771654:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771660:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726105.771685:0:17137:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788726105.771729:0:17121:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788726105.771750:0:17121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.771761:0:17121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13be9a7e00 already unused, calling callback (ffffffffc0c65230) 00000100:00100000:0.0:1788726105.771773:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15644:x1875614770536960:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 530us (751us total) trans 8589934622 rc 0/0 00010000:00010000:2.0:1788726105.771779:0:17121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726105.771790:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:2.0:1788726105.771799:0:17121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788726105.771800:0:17137:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788726105.772740:0:17121:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b1383d3f400) 00010000:00010000:2.0:1788726105.772747:0:17121:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788726105.772753:0:17121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.772796:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13be9a7e00/0xa13c582691d38768 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726105.774261:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726105.774269:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788726105.774273:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788726105.774955:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788726105.783977:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537088 00000100:00100000:0.0:1788726105.784956:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537088 00000100:00100000:1.0:1788726105.785680:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:1.0:1788726105.785696:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+21:15642:x1875614770537088:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:1.0:1788726105.785718:0:17134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788726105.785740:0:17134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d3876f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x62ed2b9f453a732f expref: -99 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785776:0:17134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38776 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785790:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785813:0:17134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38776 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785921:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949f800/0xa13c582691d3876f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a732f expref: 23 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785939:0:17134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b13a949e200/0xa13c582691d38776 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0x62ed2b9f453a732f expref: 22 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726105.785947:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b12819c9700) 00010000:00010000:1.0:1788726105.785950:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788726105.785954:0:17134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b13a949e200, rc 0) 00000100:00100000:1.0:1788726105.786025:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7602ce63-3b47-483e-9534-de4ec2d7c695+22:15642:x1875614770537088:12345-192.168.203.12@tcp:101:dd.0 Request processed in 333us (11080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726105.786033:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 64 00000100:00100000:3.0:1788726106.011731:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788726106.011865:0:18646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537216 00000100:00100000:1.0:1788726106.011875:0:18646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537216 00000100:00100000:1.0:1788726106.011956:0:18646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788726106.011968:0:18646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2397:x1875614770537216:12345-192.168.203.12@tcp:4:dd.0 00002000:00010000:1.0:1788726106.012014:0:18646:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9dcb58, atime: 0x6a9dcb57, ctime: 0x6a9dcb58, blocks: 0x0 00010000:00010000:1.0:1788726106.012023:0:18646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726106.012038:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788726106.012043:0:18646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788726106.012049:0:18646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788726106.012079:0:18646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788726106.012804:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788726106.017741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726106.017839:0:18648:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788726106.017849:0:18648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788726106.018444:0:18648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537344 00000100:00100000:3.0:1788726106.018454:0:18648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537344 00000100:00100000:2.0:1788726106.019413:0:20277:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788726106.019428:0:20277:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13af863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+8:2397:x1875614770537344:12345-192.168.203.12@tcp:4:dd.0 00010000:00010000:2.0:1788726106.019465:0:20277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726106.019481:0:20277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726106.019485:0:20277:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788726106.019491:0:20277:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788726106.019504:0:20277:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.044283:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788726106.191297:0:19456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788726106.191314:0:19456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1788726106.191461:0:20277:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788726106.191466:0:20277:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788726104 -> 1788726105 00002000:00010000:0.0:1788726106.191469:0:20277:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788726104 -> 1788726105 00002000:00010000:0.0:1788726106.191471:0:20277:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788726106.191502:0:20277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191515:0:20277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191524:0:20277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191531:0:20277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13bd610a00 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:0.0:1788726106.191536:0:20277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191544:0:20277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191563:0:20277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788726106.191571:0:20277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340448b7/0xa13c582691d38784 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20277 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788726106.191671:0:20277:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+7:2397:x1875614770537344:12345-192.168.203.12@tcp:4:dd.0 Request processed in 172244us (173935us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788726106.191686:0:20277:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000001:00080000:2.0:1788726106.236663:0:19456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788726106.236836:0:18646:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:3.0:1788726106.236856:0:18646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236868:0:18646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236878:0:18646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236885:0:18646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b13a949f800 already unused, calling callback (ffffffffc0c65230) 00010000:00010000:3.0:1788726106.236890:0:18646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236926:0:18646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236944:0:18646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788726106.236951:0:18646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce00b29/0xa13c582691d3877d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788726106.237042:0:18646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13af863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2397:x1875614770537216:12345-192.168.203.12@tcp:4:dd.0 Request processed in 225072us (225317us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788726106.237056:0:18646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00010000:00010000:3.0:1788726107.076062:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788726108.097446:0:17121:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788726108.181747:0:20314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788726109.115372:0:18289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788726109.309052:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9b128367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791578880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788726109.309144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788726109.309228:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614791578880 00000100:00100000:3.0:1788726109.309236:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614791578880 00000100:00100000:3.0:1788726109.309300:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788726109.309310:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791578880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788726109.309339:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788726109.309418:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b139e7ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875614791578880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726109.309425:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788726109.309470:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9b128367d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1875614791578880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788726109.310375:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726109.387696:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387767:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387801:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387850:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387875:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.387920:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537856 00000100:00100000:2.0:1788726109.387929:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537856 00000100:00100000:2.0:1788726109.387986:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770538368 00000100:00100000:2.0:1788726109.387990:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770538368 00000100:00100000:2.0:1788726109.388010:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788726109.388017:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537856:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388172:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537600 00000100:00100000:1.0:1788726109.388176:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537600 00000100:00100000:1.0:1788726109.388206:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770538112 00000100:00100000:1.0:1788726109.388209:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770538112 00000100:00100000:1.0:1788726109.388223:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537728 00000100:00100000:1.0:1788726109.388225:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537728 00000100:00100000:1.0:1788726109.388238:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788726109.388245:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+22:2395:x1875614770537600:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388316:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+22:2395:x1875614770537600:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 70us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.388322:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788726109.388337:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788726109.388343:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2395:x1875614770538112:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388377:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+6:2395:x1875614770538112:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.388391:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788726109.388403:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788726109.388409:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537728:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388446:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537728:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.388452:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788726109.388473:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788726109.388479:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538368:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388499:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538368:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.388504:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788726109.388635:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537472 00000100:00100000:1.0:1788726109.388639:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537472 00000100:00100000:1.0:1788726109.388661:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00100000:1.0:1788726109.388668:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2395:x1875614770537472:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.388694:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13be88a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c589f1fa-df36-4201-a9a9-13f8f3801f25+13:2395:x1875614770537472:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.388712:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 165 00000100:00080000:1.0:1788726109.388736:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788726109.388740:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788726109.388742:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788726109.389879:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b13842ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537856:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1856us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788726109.389897:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788726109.391449:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.391490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788726109.391534:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788726109.391682:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770537984 00000100:00100000:3.0:1788726109.391714:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770537984 00000100:00100000:3.0:1788726109.391772:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770538496 00000100:00100000:3.0:1788726109.391775:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770538496 00000100:00100000:3.0:1788726109.391799:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788726109.391808:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537984:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788726109.391872:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7602ce63-3b47-483e-9534-de4ec2d7c695+5:2395:x1875614770537984:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 65us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726109.391879:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788726109.391908:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:3.0:1788726109.391915:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538496:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788726109.391939:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538496:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788726109.391944:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:1.0:1788726109.392351:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875614770538240 00000100:00100000:1.0:1788726109.392356:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875614770538240 00000100:00100000:1.0:1788726109.392409:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:1.0:1788726109.392424:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538240:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788726109.392456:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b1283e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6a07b65-b968-4d55-97e9-b26237de8f88+5:2395:x1875614770538240:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 41us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788726109.392462:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00080000:2.0:1788726109.392879:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788726109.392884:0:17129:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788726110.139569:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42132 lines, 42132 kept, 0 dropped, 0 bad.